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Chapter 1 
INTRODUCTION 


ALTHOUGH ADMINISTRATION IS A CHARACTERISTIC OF ALL ORGANIZED 
effort, relatively little is known of its nature and even less of its dimen- 
sions. The present volume reports a study undertaken to explore the 
performance of those holding one important type of administrative posi- 
tion—the elementary school principalship in the public schools of the 
United States. 

The administrative performance of the elementary school principal 
was chosen because of the high degree of interest in the problems asso- 
ciated with the principalship. Boards of education, superintendents of 
schools, and the general public are demanding improved methods of 
educating and selecting school principals and of improving the adminis- 
tration of schools. 

The elementary school principalship is a highly strategic position. 
The principal is faced with a host of problems related to the conduct of 
an educational program; these include the selection, training, and super- 
vision of personnel; the maintenance of physical facilities; the control of 
supplies; and relationships between the school and the community. The 
problems that he sees and what he does about them influence the quality 
of education received by every child in his school. With the rapid 
changes in society, the steady expansion of knowledge, and the mount- 
ing population pressures, the position is becoming more and more com- 
plex. Increasing our understanding of the administrative performance of 
elementary school principals may not only improve our schools, but may 
also add to our knowledge of administration in other areas. 


Zz ADMINISTRATIVE PERFORMANCE AND PERSONALITY 


HISTORICAL BACKGROUND 


The literature on the selection and qualifications of school adminis- 
trators can be categorized in three historical periods.1 The first period 
began with a few studies before the turn of the century and continued 
through World War I. The second period began at the end of World 
War I when the major interest in the selection of school administrators 
turned to the specification of standards and qualifications for positions 
in school administration. About 1948 a third period began which was 
characterized by searches in new directions for methods of selection of 
administrators. 


THE FIRST PERIOD, TO 1918 


The first period is characterized by two studies, one by Cubberly, 
the other by Theisen. Cubberly concluded that the duties of the super- 
intendent were? 

Organizer and director of the work of the schools, executive officer of the 


school board, supervisor of instruction, leader of the staff, arbiter between 
the staff and the board. 


Theisen’s 1917 study of school board rules and regulations con- 
cluded that the most critical function of the school board was the choice 
of a superintendent of schools.® | 


THE SECOND PERIOD, 1918-1948 


For the second period, studies are found which focus on two ques- 
tions: What makes a successful school administrator? and What qualifi- 
cations should be possessed by candidates for school administrative 
posts? The search for the answers to these questions proceeded in two 
directions: (1) studies describing school administrators, especially those 
considered successful, and (2) surveys of opinions about the desirable 
qualities of school administrators held by persons involved in education, 
ranging from school board members to the children in public schools, 
from college presidents to PTA members. 

Research of the first type employed status studies of selection re- 
quirements, qualifications of incumbents, and analyses of procedures for 


*James W. Ramey, A Review of School Administrator Selection Research. 
Unpublished Ed.D. Project, Teachers College, Columbia University, 1958. See 
Appendix A of this report for a listing of the studies reviewed. 

°E. P. Cubberly, “Superintendent of Schools,” Elementary School Journal, 
Vol. 16, November 1915, p. 149. 

*W. W. Theisen, The City School Superintendent. Contributions to Educa- 
tion, No. 84 (New York: Teachers College Bureau of Publications, 1917). 
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selection. In studies using opinion surveys, a wide variety of individuals 
were asked what they thought a successful administrator was like or 
what the requirements for selection should be. 


THE THIRD PERIOD, 1948-1958 


The third period of research on qualifications and selection of school 
administrators was characterized by attempts to find new ways of un- 
derstanding the job of the administrator and to determine the necessary 
qualifications or criteria for selection. This period by no means breaks 
sharply with what had become the traditional method of studying quali- 
fications in the field of educational administration, but it can be distin- 
guished by the appearance of new directions that began to be explored 
after World War II. Dissatisfied with the small returns to that time, and 
influenced by Kellogg grants, research workers undertook studies which 
emphasized the experimental use of psychological tests, the study of 
leadership, the use of the critical incident technique, and other meth- 
odological departures from educational administration’s past. The 
focus of theoretical discussions began to shift from emphasis on traits 
of administrators to emphasis on the behavior of administrators in school 
situations.® 

One other characteristic displayed by these newer approaches was 
an interest in analyzing the administrative situation. Local control of 
education in America results in local variations in school organization. 
At present there is no useful system for the classification of different 
school characteristics which would make it possible to hold situational 
factors constant in a study of administrative behavior. 

With the bankruptcy of the search for administrative qualifications 
on the one hand, and with the variety of communities and schools on 
the other, most attempts to determine criteria of success for school ad- 
ministrators have been singularly unsuccessful. 


PROBLEMS ENCOUNTERED IN STUDYING 
ADMINISTRATIVE BEHAVIOR 


The design of the present study was influenced by knowledge of the 
difficulties and frustrations of past research. 


“Hollis Moore, Studies in School Administration (Washington, D.C.: Ameri- 
can Association of School Administrators, 1957). j 

*For a description of this development, see Roald Campbell and Russeli 
Gregg, eds., Administrative Behavior in Education (New York: Harper and 
Brothers, 1957). 
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LACK OF CRITERIA 

The usual criterion employed to evaluate effectiveness of perform- 
ance in studies of administrative behavior is a rating or set of ratings 
made by superiors. 

The weaknesses of criteria of this sort are well known. Judges view- 
ing those to be judged may use frames of reference that differ according 
to their values, experiences, and training. What is “good” behavior to 
one judge may be “poor” to another. Furthermore, the ratings often in- 
volve the assumption that the performance is one-dimensional, varying 
from “good” to “bad.” Such a view oversimplifies the problem. Obvi- 
ously, more dependable criteria of effective administrative performance 
are required if the many problems involving identification of the abilities 
required of school administrators and the selection of potentially effec- 
tive principals are to be solved. 


LACK OF CONCEPTS 

The language of research in administrative behavior is another 
source of difficulty. There is a lack of serviceable concepts with which to 
describe what is observed, and researchers are handicapped in their efforts 
to describe administrative situations. Even the most sophisticated stu- 
dents of school administration must resort to homely parables and 
analogies to talk about administration. As Simon says:® 


We talk about organization in terms not unlike those used by a Ubangi medi- 
cine man to discuss disease. At best we live by homely proverbs: “The im- 
portant thing about organization is to have the right man in the right place.” 
At worst we live by pompous inanities: “The relationship between delegant 
and his deputy arises from delegation and is invariable in character.” 


The lack of appropriate concepts has made it very difficult to de- 
scribe administrative situations or administrative behavior adequately. 


OPERATIONAL DIFFICULTIES 


It seems obvious that researchers must look at administrators at 
work if they are to gather truly relevant data. Making such observations 
presents serious problems for the research worker. The cost of obsery- 
ing a large number of administrators over a period of time is exorbitant; 
and even if the cost obstacle could be overcome, other problems must 
be faced. 

The presence of the observer is an added variable in the maze of 


* Herbert Simon, Administrative Behavior, Second Edition (New York: The 
Macmillan Company, 1957), p. xiv. 
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factors which influence behavior, and efforts to overcome the effects of 
his presence have not been entirely successful. Not only does the ob- 
server change the situation merely by being in it, but different observers 
perceive the same situation quite differently. Each tends to have his own 
frame of reference within which he interprets what he sees. 


SITUATIONAL DIFFERENCES 


A major difficulty in the study of administrative behavior is the fact 
that every administrative situation varies from every other situation. This 
fact may lead to conflicting conclusions about administration; it may be 
impossible to tell to what extent behavior is a function of the situation or 
of the administrator. Many researchers who have employed survey 
techniques have either ignored this difficulty or have contended that 
through the use of statistical methods the effects of different situations 
can be ruled out. Those who employ the case method of study often are 
prone to overgeneralize from one or two cases. When situations are 
compared, the variables involved are not only difficult to control; they 
may even be unknown to the researchers. 


LACK OF QUANTIFICATION 


An outgrowth from the lack of operational concepts has been the 
great difficulty in quantifying observations obtained in the study of ad- 
ministration, and this imposes serious restrictions on the ways in which 
data can be handled. If the relationships among variables cannot be 
analyzed by quantitative techniques, there is little hope of determining 
precisely how they interact and influence one another. 

These difficulties are part of the research background that is rele- 
vant to the design of present-day research studies. From a methodologi- 
cal point of view, this entire study may be understood as an effort to 
overcome the five major difficulties discussed above. 


THE CONCEPTUAL FRAMEWORK 


The conceptual framework of any study has two major aspects: that 
which is made explicit and is formally stated in terms of a theory, model, 
or paradigm, and that which is implicit and contains unstated and per- 
haps unrecognized assumptions held by the researchers. 


THEORIES HELD BY RESEARCHERS 


The research project had, from its beginnings, a rather sizable re- 
search staff with backgrounds in different academic disciplines. The 
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members of the staff had various orientations toward the place of theory 
in research. In addition, the interests of the staff were varied. For ex- 
ample, one member of the staff was especially interested in the rela- 
tionships between personality factors and administrator performance, 
while another was concerned particularly with developing methods of 
observing administrators at work. An over-all conceptual framework 
was developed from these diverse backgrounds of interests and orienta- 
tions. While no attempt was made to force all views into an integrated 
or consistent single point of view, it is important to identify the major 
theoretical views and interests which became involved in the research. 

Administration as problem solving. A theory of administration 
viewed as problem solving had been proposed by one member of the 
research team.” According to this theory, insight into the nature of 
administration can be gained by studying the group problem-solving be- 
havior of administrators. The theory is essentially a psychological ap- 
proach that concentrates on the behavior of the individual leader. It 
examines the relationship between the leader and the group and deline- 
ates the conditions that give rise to leadership acts. 

Administration as decision making. A theory proposed by another 
member of the research staff considered administration from the point 
of view of decision making.® The theory defines and utilizes a set of con- 
cepts including decision making, organization, perception, communica- 
tion, power, and authority. It accounts for differences in administrative 
behavior in terms of variations in decision-making behavior and borrows 
from the work of Barnard® and Simon.?° 


EMPIRICAL ORIENTATION 


In addition to the two theoretical referents mentioned above, the re- 
search staff included members representing a third basic orientation— 
empiricism. The staff could accommodate two theories and at the same 
time admit an empirical point of view for two reasons: The first was a 
clear recognition of the inadequacy of the administrative theories; the 
second can be traced to advances made in modern computational 
methods. 


"For a more detailed discussion of this theory see John K. Hemphill, “Ad- 
ministration as Problem-Solving,” in Administrative Theory in Education, edited 
by A. W. Halpin (Chicago: Midwest Administration Center, 1958), pp. 89-118. 

*For a more complete discussion of this theory see Daniel E. Griffiths, 
Administrative Theory (New York: Appleton-Century-Crofts, Inc., 1959). 

* Chester Barnard, The Functions of the Executive (Cambridge: Harvard 
University Press, 1947). 

* Simon, op. cit. 
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Inadequacy of theories. It was readily admitted that neither of the 
theories presented above, nor for that matter any known theory of ad- 
ministration, was substantial enough to support a major inquiry of the 
sort projected. Theory building can best be done in the light of thorough 
familiarity with the phenomena which are in the domain of investigation. 
Administrative science is immature and constantly needs to examine its 
stock of theories in the light of empirical findings which may lead to the 
reformulation of present theories or the creation of new ones. 

Modern computational methods. The research staff strongly be- 
lieved that modern computers are greatly influencing the nature of re- 
search in the behavioral sciences. As Wrigley has intimated, the advent 
of the computer may be as significant to the behavioral sciences as was 
the telescope to astronomy or the microscope to biology.14 The computer 
may be the aid that has long been needed to provide facts which can 
then be accounted for by theories. While school administration has few 
theories, it has still fewer facts. 

There was agreement among members of the staff that the research 
should be primarily concerned with making observations of administra- 
tive behavior, and that it should attempt to relate these observations to 
many other variables as a means of gaining greater understanding of the 
observations. The staff was also in agreement that it should not develop 
a new theory of administration within this study, but would be con- 
cerned with making the observations which are the prerequisite of theory 
building. 


OBJECTIVES OF THE STUDY 


The objectives of the study developed out of the background of re- 
search in administrator qualifications and selection, the problems which 
have been encountered in the study of administrative behavior, and the 
conceptual orientation of the researchers. The study had three major 
objectives. 


1. To determine dimensions of performance in the elementary school 
principalship and thus to develop a better understanding of the nature of 
the job of the school administrator. 

In this study an effort is made to describe and understand the ad- 
ministrative behavior of elementary school principals. To do this, it is 
necessary to develop concepts which are consistent with the modern 


™ Charles Wrigley, “Theory Construction or Fact-Finding in Computer Age,” 
Behavioral Science, Vol. 5, No. 2, April 1960, pp. 183-186. 
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principles of operationism. The first objective of the study can be 
thought of as the development of concepts with which to describe the 
administrative behavior of the elementary school principal. 


2. To provide information helpful in the solution of the problem of 
selecting school administrators. 

Success in determining some measurable dimensions of performance 
in elementary school administration and in developing knowledge of the 
relationships of these dimensions to other measurable characteristics of 
people may be expected to suggest practical procedures for the selection 
of principals. 


3. To provide materials and instruments for the study and teaching 
of school administration. 

The materials developed in the course of the project should be useful 
for the study and teaching of school administration. These materials, to 
be described in detail in later chapters, included motion pictures, a film- 
strip, sound tapes, and a large number of situational test materials, and 
simulate a school within a school district. They provide a wealth of ma- 
terial for demonstration and discussion. 


A standard administrative situation was constructed in which ad- 
ministrative behavior could be elicited and observed or recorded. Im- 
portant tasks from the job of the elementary school administrator were 
simulated and condensed within the period of one week. Details of how 
this simulation was accomplished will occupy a good part of the first 
few chapters of this report. 

One of the more important means employed to simulate administra- 
tive tasks was the in-basket test.1* Everyone is familiar with the baskets 
or trays that administrators generally have on their desks to keep in- 
coming and outgoing correspondence separate. An in-basket test is a 
collection of items which have presumably accumulated in the in-basket 
of an administrator and are awaiting his attention. These constitute the 
test items, and the action which the administrator takes with respect to 
them are his responses to the test. Four in-basket tests were employed 
in the study. 

It was possible to include a wide range of the tasks of the elemen- 
tary school principal in these in-basket test items. However, several 
other methods of presenting tasks were used to simulate problems in- 
volving more direct interaction with people. For example, each princi- 


* Norman Frederiksen, D. R. Saunders, and Barbara Wand, “The In-Basket 
Test,” Psychological Monographs, Vol. 71, No. 9 (whole No. 438), 1957. 
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pal who participated in the study visited the classrooms of his proba- 
tionary teachers via kinescope recordings, prepared and presented a 
speech to his PTA, and participated in a group discussion. All the 
various methods or techniques of simulating tasks were built into a 
hypothetical school named Whitman School. Before the principals be- 
gan work on these tasks, they received a complete briefing on the school, 
its faculty, the school district, and the community. 

In the present study, all stimulus materials remained the same, re- 
gardless of what the subjects had done previously. In other words, no 
feedback from their earlier work was provided in the materials they en- 
countered later. Thus, the study is based on a series of noninteracting 
cross-sections of what, in reality, is a continuously interacting environ- 
ment. The implications of a dynamic or transactional environment cer- 
tainly merits its consideration in simulation, but the penalty with its use 
is a large one and entails a compromise with standardization of the 
stimulus materials. In this investigation it was decided not to sacrifice 
standardization for the opportunity to observe dynamic processes. 

In addition to the large amount of information that was obtained 
on the performance of the principals on the simulated administrative 
tasks, an almost equally large amount was obtained about each princi- 
pal’s abilities, personality, background, and performance in his home 
school. A major task of the study was the analysis and interpretation of 
the relationships among a large number of variables. 

To give the reader an overview of this study, the contents of each of 
the following chapters is briefly described here. 

Chapter 2, “Collecting the Data,” describes the data-gathering pro- 
cedure, beginning with the first contact with the subject and continuing 
through the week spent at the test center. 

Chapter 3, “The Simulated School,” discusses the setting in which 
the in-basket items are placed. The characteristics of the community of 
Jefferson and of Whitman Elementary School are presented. 

Chapter 4, “Structuring Whitman School,” describes how the movie, 
the kinescopes, in-basket items, filmstrips, sound tapes, and all the 
other materials were prepared. 

Chapter 5, “The Participants in the Study,” describes the principals 
who participated in the study, and compares them with a nationwide 
sample of principals recently studied by the National Education Asso- 
ciation. Means and standard deviations are reported for the professional 
knowledge, general culture, personality, and interest tests administered 
to the subjects. 

Chapter 6, “Scoring the In-baskets,” presents the rationale for scor- 
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ing in-basket materials. A central part of the chapter deals with the 
Scoring Manual, training of the scorers, the scoring categories, and qual- 
ity control measures employed. 

Chapter 7, “Dimensions of Performance in In-basket Work,” deals 
with three questions: Can the adding of scores assigned to items to ob- 
tain a total score for each category be justified? How reliable are the 
category scores? Can the important differences in the subjects’ perform- 
ance be described with less than the 68 categories used in scoring the 
in-baskets? 

Chapter 8, “The Content of the In-basket Test,” contains a discus- 
sion of two “content” scores, Jmaginativeness and Organizational 
Change, and their relation to other measures. 

Chapter 9, “Concerns and Values of Elementary School Principals,” 
describes, evaluates, and analyzes the subjects’ concerns and values as 
revealed by three types of tasks: evaluation of the performance of 
teachers shown in kinescopes, solutions to a variety of situations depict- 
ing educational problems that were presented by taped recordings, and 
“examinations” on background materials. 

Chapter 10, “Performance on Tasks Involving Group Interaction 
and Speaking Before a Group,” presents a description, evaluation, and 
analysis of the subjects’ behavior in a group interaction problem and in 
giving a speech. 

Chapter 11, “Subjective Evaluations of Performance,” provides an 
answer to the question, What are the characteristics of principals who 
are viewed as outstanding by their superiors, by teachers, by scorers, and 
by members of the research staff? 

Chapter 12, “Relationships Among Measures of Performance,” pre- 
sents the correlations between in-basket performance measures and all 
other variables pertaining to the principals’ abilities, personalities, and 
performance. 

Chapter 13, “Components of Administrative Performance,” reports 
the results of an analysis of various components of the in-basket test 
performance factor, and summarizes the most significant findings of the 
study. | 

Chapter 14, “Implications for the Practice of Administration,” sum- 
marizes the findings of the study and explores implications for new 
theories of administration. The chapter presents practical applications 
for the selection of school administrators, the practice of school admin- 
istration, and the preparation of school administrators; and it suggests 
further needed research. 

In the technical appendices included in this volume, Appendix D 
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presents the “Differences between Men and Women Principals on 137 
Variables Employed in the Study.” Appendix E, “Over-all Relationships 
Among the Major Areas of the Study,” contrasts with the analysis made 
in Chapter 13, where the relationships among variables are viewed from 
a framework provided by the factor analysis of in-basket test performance. 
In this appendix the over-all relationships among the various major areas 
of the study are examined. Appendix F, “An Alternate Rotation of 
Second-order In-basket Test Factors,” presents an interpretation of the 
performance of the principals that is different from that obtained in the 
original rotation. 


Chapter 2 
COLLECTING THE DATA 


IN THIS CHAPTER THE PLANNING AND PREPARATION NECESSARY FOR 
setting up the test centers is described, along with the events of the 
standard test week during which groups of approximately 20 each of 
the 232 principals who participated in the study left their regular work 
and came to a test center to serve as principal of the simulated school. 


ARRANGEMENTS FOR THE TEST WEEK 


The test week was conducted 12 times in 11 centers located in 
various parts of the United States. With 20 or so participants involved 
in each center, living at a location away from home, and with a good 
deal of equipment to be assembled at each center, including projectors, 
screens, and tape recorders, as well as a great variety of printed mate- 
rials, it is obvious that even from a logistics point of view a lot of 
planning was needed for the successful conduct of the project. This 
section deals with the selection of schools, of subjects, and of test centers, 
as well as the collection of other information about the participants in 
the study. 


CHOOSING THE SCHOOLS 


Since many of the important parameters of the population of ele- 
mentary school principals are unknown, there was little basis for a 
systematic selection of a sample. It was decided to choose school districts 
primarily on the basis of these criteria: geographic location, size of 
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TABLE 1. 


principals participating 


Test Center Location 


Hilltop House 
Harpers Ferry, W.Va. 


Hilltop House 
Harpers Ferry, W.Va. 


Punderson State Park 
Ohio 
Student Union 


Oklahoma State Univer- 
sity, Stillwater, Okla. 


New Ocean House 
Swampscott, Mass. 


Lake Wilderness Lodge 
Maple Valley, Wash. 


Mayfair Hotel 
Colorado Springs, Colo. 


Lake St. Mary 
Michigan Education 
Association Camp, 
Battle Creek, Mich. 


Sonoma Mission Inn 
Boyes Spring, Calif. 


Florida A. & M. University 
Tallahassee, Fla. 


Colonial Inn 
St. Petersburg, Fla. 


American Hotel 
Freehold, N.J. 


Date 
May 19-23, 1958 
May 26-30, 1958 
June 23-27, 1958 


Oct. 13-17, 1958 


Oct. 27-31, 1958 


Nov. 3-7, 1958 
Nov. 10-14, 1958 


Nov. 17-21, 1958 


Jantel9=23 91959 


April 6-10, 1959 


April 13-17, 1959 


April 27— 
May 1, 1959 


Locations and dates of test centers, school districts, and numbers of 


Number 


School Districts of 
Represented 


Baltimore, Md. 23 
Baltimore, Md. 22 
Willoughby, Ohio 10 


Oklahoma City, Okla. 20 


Lynn, Mass. 
Gloucester, Mass. 
Concord, Mass. 
New Britain, Conn. 
Bennington, Vt. 
Warwick, R.I. 

E. Providence, R.I. 
Manchester, N.H. 
Concord, N.H. 
Portland, Me. 


Tacoma, Wash. 
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Denver, Colo. 


Lansing, Mich. 
Ann Arbor, Mich. 
Jackson, Mich. 


NA NAN oO 


San Rafael, Calif. 
Berkeley, Calif. 
Modesto, Calif. 
Mt. Diablo, Calif. 


Orange County, Fla. 
Hillsborough County, Fla. 
Pinellas County, Fla. 
Leon County, Fla. 


Hillsborough County, Fla. 20 


Man NAAan 


—_ 


=m oN © 


Allentown, Pa. 
Greeces Nay: 
Smithtown, N.Y. 
Bronxville, N.Y. 
Tarrytown, N.Y. 
Uniondale, N.Y. 
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school district, and type of school district. No attempt was made to ob- 
tain a sample of principals which was representative of the population 
of elementary school principals in the United States; but it was hoped 
that the criteria used would produce a sample which was almost as 
varied as the population. 

A list of suitable districts was developed, and the project was dis- 
cussed by telephone with the superintendent of schools in each district. 
Tentative commitments to participate in the study were made in a high 
proportion of calls. A detailed description of the proposed study was 
mailed to each superintendent, and in many cases he was visited by a 
staff member who answered questions, talked to principals, negotiated 
a financial arrangement for sharing expenses, and made other necessary 
local arrangements. 

Thirty-two different school districts participated in the study; each 
provided from one to 45 principals who served as subjects. The school 
districts are shown in Table 1, along with test center locations, testing 
dates, and the number of principals from each school system. 


CHOOSING THE PRINCIPALS 


No principal was required by his superintendent to participate in the 
study; all principals who took part did so voluntarily. It was necessary, 
of course, to inform the principals in advance about the study, the na- 
ture of the tasks required of them, and the confidential nature of all in- 
formation obtained. A meeting attended by the principals, a member of 
the school administration, and a member of the research staff was usu- 
ally held for the purpose of providing such information. The proportion 
of principals who were willing to participate varied from one school 
system to another, but was usually high. 

The research staff wanted a wide diversity among the principals 
studied. In some smaller districts, all the principals were asked to par- 
ticipate. In large school districts, the school officials were asked to select 
approximately equal numbers of principals considered to be among the 
most able and the least able. It was hoped that by choosing school dis- 
tricts and principals within. school districts which were diverse, the 
sample of principals would be varied enough to reveal clearly the inter- 
relationships of the measures employed in the study. 


LOCAL ADMINISTRATIVE ARRANGEMENTS 

A liaison officer was appointed to serve as local coordinator for each 
of the test centers; he was usually the supervisor of elementary education 
for the participating district most involved in the particular center. The 
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liaison officers were particularly helpful in communicating with the prin- 
cipals, obtaining data from the superintendent’s office, and making ar- 
rangements for the test center. 


THE TEST CENTER 


The schedule established for the test week was a very full one, includ- 
ing evening as well as day-time activities. The investment of time and 
effort in the study by the principals made it highly desirable that no cases 
be lost because of incomplete data. These considerations led to the de- 
cision to conduct the test weeks at locations where the principals would 
be free from interruptions and where they could live together. With the 
help of the liaison officers, a location was found for each test week which 
was within easy traveling distance for the principals, but far enough 
away to discourage communication with the home school. Sometimes 
the center was located in an off-season resort hotel, sometimes in the 
student union building of a university. The location of each center is 
shown in Table 1 and on the map (Figure 1). 

A list of criteria was drawn up by the staff to help the liaison officer 
in choosing the center location. Facilities for housing and feeding par- 
ticipants and staff members were, of course, necessary. Criteria also in- 
cluded availability of adequate desk space for the principals, adequate 
ventilation and lighting of the work room, feasibility of darkening the 
room for viewing films and kinescopes, adequate acoustic properties, 
availability of space for the committee meetings and speech recording 
sessions, and for storage of materials. 


COLLECTION OF OTHER DATA 


One important objective of the study was to investigate the relation- 
ships of measures of administrative behavior (obtained from the tasks 
of the test week) to personal characteristics of elementary school prin- 
cipals. These characteristics are reflected by biographical data, scores 
on a variety of measures of ability, interest, and personality, and judg- 
ments of superiors and subordinates. For the most part this information 
was obtained prior to the test week. 

One to two weeks before the test week, the principals who were to 
attend each center met with a member of the research staff. At this pre- 
liminary meeting the project was discussed with the principals and they 
were given an opportunity to ask questions about the project and their 
role in it. It was on this occasion that a packet of test materials was 
given to each principal which he was to fill out at home and mail to the 
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research staff. The packet contained a biographical inventory, the Sixteen 
Personality Factor Questionnaire, the Strong Vocational Interest Blank 
for Men, the Symonds’ Educational Interest Inventory, and a test of ad- 
ministrative attitudes. 

On the following day, usually a Saturday, the group met for an all- 
day session at which the supervised portion of the battery was admin- 
istered. This included School Administration and Supervision, Edu- 
cation in the Elementary School, and a battery of 13 tests of cognitive 
abilities selected to measure certain aptitude factors. 

The liaison officer made the preliminary arrangements for the test- 
ing as described above, and, in addition, collected other items of infor- 
mation about the principals. He arranged for a meeting of the teachers 
serving in each principal’s school and at this meeting distributed two 
forms: the Teacher Reaction Form and the Principal Behavior Descrip- 
tion Questionnaire (described in Chapter 11). The liaison officer also 
obtained from the superintendent’s office a standard set of objective data 
which was compiled as the principal’s Professional Experience Record; 
this form included such items as years of experience, sex, age, and 
education. 

The remaining task performed by the liaison officer was to obtain 
from the superiors of each principal a completed Superiors’ Rating 
Form, which provided a subjective evaluation of the principal’s per- 
formance in his own school. From two to four superiors filled out the 
form for each principal. The form provided an opportunity for the su- 
perior to make evaluations of work in specific areas as well as a general 
over-all evaluation. 


THE TEST WEEK PROGRAM 


During the test week, each principal became acquainted with Jeffer- 
son, its school system, and the faculty and facilities of Whitman School. 
He handled a large number of administrative problems presented to him 
through a variety of methods designed to make these problems real for 
him. The following pages give a day-by-day account of the events of 
the test week. 


SUNDAY AFTERNOON AND EVENING 


As the principals arrived at the test center on the Sunday afternoon 
of the test week, staff members were on hand to meet them, to help them 
get established, and to acquaint them with the facilities of the center. 
The principals were encouraged to join in whatever informal discussions 
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and activities were in progress. Every effort was made by the staff to 
develop a friendly and informal atmosphere. 

The staff members did not avoid talking about the test week. The 
principals were expected to be curious and somewhat apprehensive. Suf- 
ficient information about the test week and about the purpose of the 
study was given to reduce anxiety and to prepare the principals for the 
more formal introduction to the study on Monday morning. 

The Supervisor's Manual used in the administration of the test week 
contains the following guides regarding the impressions of the study 
which staff members were to give to the principals: 


1. No report of any sort on the individual performance of principals will 
be given to anyone; data will be used only for research purposes. 


2. This is an experiment. Until the value of the experimental materials 
is known, it would be unscientific and unethical to attempt to say 
anything about the quality of an individual’s performance. 


3. This is a new kind of research. Most of the materials to be used this 
week have not been tried before. Principals may expect to find oc- 
casional inconsistencies. When this happens, we hope the intent will 
be clear and that the errors will not prove distracting. We hope also 
that any inconsistencies will be called to our attention. 


4. The purpose of the research is to study the work of the elementary 
school principal. We hope to learn something about how different 
kinds of administrative behavior are related. We think we may find 
a number of consistent patterns of administrative behavior and that 
these patterns may be related to the background tests taken earlier. 


5. We expect that the outcomes of this research may eventually lead to 
improvement in the understanding of administrative processes, in the 
content of college courses in educational administration, and in 
methods for selecting educational administrators. 


6. Each principal will serve as principal of a hypothetical elementary 
school in an imaginary town in an imaginary state. 


7. This imaginary school and community are based largely on a real 
school and community. We have, however, changed a number of 
things about this community and have added parts from other com- 
munities. The school is a good school in a comfortable suburban 
community. Under no circumstances will the real community’s 
identity be divulged. 


Staff members used these general guides in their informal discussions 
with the principals on Sunday afternoon and evening, but avoided re- 
vealing the specific content of the test week. At the end of a very short 
meeting with the principals following the evening meal, a pamphlet en- 
titled “Program for the Week” and indicating the activities scheduled for 
each day was distributed. 
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MONDAY MORNING 

The principals assembled at 8:45 on Monday morning to begin the 
formal test week. Each selected a work table which was to be his 
“office” for the entire test period. On his table he found a large file 
folder identified by a testing number which served to identify all the 
work he performed during the week. 

The supervising staff member began the morning with a detailed 
formal introduction to the test week. He covered the following major 
points: 


1. We have reproduced a realistic situation involving a hypothetical ele- 
mentary school. 


2. Our research objective is to achieve a comprehensive understanding 
of public school administration. 


3. The first day and a half of the week will be used to introduce the 
school and to give facts that are ordinarily available to a principal 
working in a community. 


4. From now until Friday morning each principal is to be Marion Smith, 
principal of Whitman School, in the Jefferson School District in 
Washington County of the state of Lafayette. 


5. Each Marion Smith is supposed to have had only the briefest intro- 
duction to his (or her) new position—a short visit to the community 
and a meeting with members of the Board of Education and with Dr. 
Donnelly, the Superintendent. 


After this introduction the principals were shown a filmstrip (de- 
scribed in more detail in Chapter 6). This filmstrip, accompanied by a 
taped commentary, took the new principal on a tour of the community 
with a well-informed guide. After the filmstrip was shown, Examination 
Booklet I was distributed. It contained three questions asking for “off- 
the-cuff” reactions or impressions of Whitman School based on the film. 
The principals were allowed to retain the examination booklets and were 
told that at the end of the afternoon they would have an opportunity to 
answer the same three questions again. This short examination was the 
first of a series of such devices used during the first day and a half. The 
devices were of two sorts: (1) tests which primarily served the purpose 
of motivating the principals to acquire as much background information 
as possible, and (2) guides which ensured that each principal gave approx- 
imately the same amount of attention to each of the various areas of 
background material. These helped to achieve greater standardization 
in the background acquired. A third purpose of these tests and guides 
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was to provide research data for the study of values described in Chap- 
ter9: 

After the test on the filmstrip was completed, a copy of the Jefferson 
School-Community Survey was distributed to each principal. The prin- 
cipals were permitted to study this 152-page document until 10:30, at 
which time Study Guide A was distributed. Study Guide A required 
each principal to answer certain questions about the Jefferson schools; 
it thus directed his attention to the several parts of the survey. 

The principals were instructed to work individually in their study, 
but were free to walk about, stretch, or help themselves to coffee. The 
principals were permitted to retain their copies of the survey and study 
guide for the balance of the week. 


MONDAY AFTERNOON 


Monday afternoon’s work started at 1:30 P.M. with the showing of 
a sound motion picture entitled, “You Will Enjoy Teaching in Jeffer- 
son.” It was explained that this color film was prepared at the request 
of the Jefferson Teachers Association by an amateur photographer (a 
member of the faculty of Whitman School) to acquaint prospective 
teachers with the school system and the community. The film ran ap- 
proximately 45 minutes. It took the principal inside Whitman School 
to see the children and staff at work. The showing of this film was fol- 
lowed by a five-minute period during which the principals were allowed 
to make notes on the film’s content for their own future use. 

The second activity of the afternoon was the study of materials per- 
taining to the personnel of the school district, a roster of the chief ad- 
ministrative officers of the Jefferson school system and of the staff of 
Whitman School, the Study of the Whitman School Faculty (a sociologi- 
cal study presumably done by a graduate student), a file of the personnel 
folders on each Whitman teacher, and the floor plan of Whitman School. 

At 3:00 P.M. Study Guide B was distributed, again for the purpose 
of focusing the principals’ approach to the background materials under 
study. Examination Booklet 2 was distributed at 4:10 P.M.; it contained 
three questions asking for the impressions the principals had developed 
during their study of the materials. This completed the work for the day. 

Many principals stated that they were unable to cover all the ma- 
terial that had been presented to them, and some wished to continue 
their study during the evening. In order to standardize the length of time 
spent in study, no one was permitted to take documents from the test 
room or to spend the evening studying. 
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TUESDAY MORNING 

Tuesday morning’s work started with the playing of tape recordings 
of three incidents that conveyed information about Whitman School. 
The recordings were introduced as another device to enable the prin- 
cipals to learn facts and form attitudes about Whitman School. It was 
explained that there were no implications that Marion Smith had actu- 
ally overheard the people involved. After each incident was heard, the 
principals were given three minutes to make notes. 

Several small items were distributed to the principals for review and 
study. These included The Jefferson Staff Handbook, The Board State- 
ment of Policies and By-laws, a copy of a recent school census, a report 
of pupils’ test scores, a class size list, a school calendar, and a regular 
calendar for the year 1958-59. The principals were permitted to study 
these materials without guidance until 10:15 A.M., at which time Study 
Guide C was distributed. 

At 11:25 A.M. the principals were required to put all the back- 
ground materials aside and to take an achievement test. This test con- 
sisted of 100 specific items sampling the content of all the background 
materials. The principals were required to answer from memory; they 
were not permitted to consult the background documents, study guides, 
or their notes. Scores on this achievement test would be used in the 
study as a measure of the amount of background acquired during the 
first day and a half of the test week. 


TUESDAY AFTERNOON AND EVENING 


On Tuesday afternoon Marion Smith’s formal orientation had been 
completed and he began to perform his duties as principal of Whitman 
School. The afternoon was spent in carrying out three specific assign- 
ments that might normally be faced by a new principal. At 1:30 P.M. 
the principals were given instructions for two of these tasks: to write a 
250-word autobiographical sketch for the school page of the Daily Rec- 
ord, the local newspaper; and to write an article for the first issue of the 
Whitman School Magazine, a student publication. It was explained that 
the directions for the third task would be given later. 

The third task was the preparation and delivery of a ten-minute 
speech to the local PTA on the topic, “The Value of Education in 
America.”” Rooms where the speeches were to be delivered had been 
set up with tape recorders. Scheduling the delivery of speeches was ac- 
complished through instruction cards distributed at prearranged inter- 
vals. At the typical center, four rooms with recorders were available. 
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Beginning at 2:00 P.M. and at 15-minute intervals thereafter, instruction 
cards were given to four principals at a time (starting at the rear of the 
room to avoid disturbing others who had not yet received their cards). 
Each card contained instructions for preparing the speech and included 
the message that at the end of 45 minutes the principal would be es- 
corted to a room where his speech would be recorded. The 45 minutes 
were to be used to prepare the speech. Each principal was taken to the 
recording room and introduced to the PTA by a staff member, who then 
left the room. He returned after 10 minutes, turned off the recorder, and 
prepared it for its next user. After the speech was recorded, the principal 
resumed his writing. At 4:10 P.M. the newspaper and magazine articles 
written by the principals were collected and the group was dismissed 
until 8:00 P.M. 

In the evening, the principals were asked to take two subtests of the 
National Teacher Examinations, Common Examinations. The subtests— 
one sampling general cultural knowledge of Mathematics and Science, 
the other Social Studies, Literature, and Fine Arts—each required one 
hour. 

From the point of view of the principals, Tuesday evening was the 
low point of the test week. They had just completed a day and a half of 
strenuous study of background materials. The morning achievement 
test had shown them that they had been unable to learn all the back- 
ground information. The tasks of Tuesday afternoon, especially the 
preparation and delivery of a speech, were almost traumatic for some. 
The administration of the NTE subtests in the evening terminated a very 
full day. 


WEDNESDAY MORNING AND AFTERNOON 


On Wednesday morning the principals began the first of a series of 
four in-basket tests. ‘Two packets of materials were distributed to each 
principal, one marked A, the other B. The B packet contained an as- 
sortment of stationery and supplies to be used with each of the first three 
in-basket tests. Packet A contained the items of the first in-basket and 
a sheet of instructions which described the general setting for In-basket 
A and gave specific directions as to how each principal was to work on 
the problems it contained. . 

The setting for In-basket A was Labor Day, the day preceding the 
first day of school. It was Marion Smith’s first day on the job. A sum- 
mer work commitment and the necessity of moving his family to a new 
community had precluded earlier attention to the many problems of the 
beginning of a school year. Marion Smith had managed a brief visit to 
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his office on the preceding Friday, at which time he instructed his secre- 
tary, Ruth Platz, to get together those things that needed his attention 
and to leave them on his desk. The materials in Packet A were the items 
she had assembled. Since it was a holiday, no one else was around, the 
switchboard was closed, and Marion Smith had to work on the contents 
of his in-basket without help. He had only 2 hours and 15 minutes to 
work, but, of course, wanted to get as much done as possible. 

At the end of the period allotted to the principal for work on his in- 
basket material, he was asked to stop and complete a Reasons-for-Action 
Form, for which 45 minutes were allowed. (This form was completed 
out of role.) In completing the Reasons-for-Action Form, each princi- 
pal indicated very briefly what he did in response to each item and why 
he did it. This information was needed to clarify (for later scoring) the 
nature of each course of action the principal had taken and the motives 
which prompted the action. 

On Wednesday afternoon the principals worked on a second set of 
in-basket materials (Packet C). The setting for these items was as fol- 
lows: On Monday, Tuesday, and Wednesday, December 1, 2, and 3, 
Marion Smith attended the Lafayette State Elementary Principals Asso- 
ciation Convention, and had therefore not been in his office since the 
preceding Friday. The contents of Packet C had accumulated on his 
desk. His secretary, ill with a severe cold, was out of the office when he 
returned. Marion Smith’s work was limited to 2 hours and 15 minutes 
because of a scheduled conference with the superintendent which was to 
take the remainder of the day. At the end of the allotted time, the prin- 
cipals were given 45 minutes to fill out the Reasons-for-Action Form. 

The morale of the principals was relatively high at the end of the 
day. The in-basket items were subjects for lively informal discussions. 
Many principals observed that problems presented in the in-basket test 
were very similar to real problems they had handled in their home 
schools. There was a general feeling that the test materials were relevant 
to their work as school administrators and provided an opportunity for 
them to show their skills. 


THURSDAY MORNING 


The principals continued to work on in-basket problems on Thurs- 
day morning. In-basket D was set in February. Marion Smith had been 
unable to get to his desk for several days because of a very heavy sched- 
ule of conferences and appointments. He had a new secretary and could 
not rely on her for much help. In-basket D had some items of an 
emergency nature which were presented by the use of short tape re- 
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cordings. There was also a mail delivery in midmorning. Again, time 
was limited to 2 hours and 15 minutes, with an additional 45 minutes 
reserved for the Reasons-for-Action Form. 


THURSDAY AFTERNOON 


Thursday afternoon brought a change of pace with two entirely 
different sets of tasks. The first set of tasks, recorded on tape, presented 
a series of five conferences on educational problems (as described in 
Chapter 4). At the end of the recording of each conference, Marion 
Smith was allowed six minutes to answer four questions on the particu- 
lar problem of that conference, using a special booklet prepared for the 
purpose. At the end of six minutes the recording of the next conference 
was presented. 

The second set of special educational problems consisted of three 
15-minute kinescopes showing teachers working with their classes. Each 
of the three teachers was on probationary status at Whitman School and 
Marion Smith visited their respective rooms by way of the kinescopes. 
Immediately after viewing each teacher’s performance, each principal 
was allowed 15 minutes to complete a probationary teacher report form 
and to outline an interview he planned to have with the teacher. 


THURSDAY EVENING 


Thursday evening was devoted to still another type of special prob- 
lem. Each principal was assigned to a group, usually of five members, 
and as a member of the group took part in face-to-face discussion of a 
problem. Each group made up a special committee appointed by the 
superintendent to advise him on the selection of a new principal for 
Whitman School. It was mentioned that Marion Smith had done an ex- 
cellent job during the past year and had accepted a position of higher 
responsibility in the system; a new principal for Whitman School there- 
fore had to be selected. The committee was provided with credentials on 
the three top candidates and given an opportunity to study them. The 
chairman of the committee was a staff member who assumed the role 
of the Assistant Superintendent for Business, who was pinch-hitting for 
the Superintendent. In this role the staff member remained out of the 
discussion, professing lack of knowledge of the problems, and assuming 
the task of taking notes on the meeting. Actually the staff member occu- 
pied himself as an observer; a second staff member, who sat apart from 
the group, also served as observer. The discussion of the candidates was 
allowed to continue for 30 minutes or until a decision was reached. 
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FRIDAY 

The principals completed their work as Marion Smith on Thursday 
evening. Their task for Friday morning was to work on a fourth in- 
basket test which was set in a business situation. This test was intro- 
duced into the program for the week to secure data from a different type 
of situation and thus to broaden the range of problems faced by the 
principals. There was also interest in making comparisons of behavior 
in the two types of situation. The Bureau of Business In-basket Test 
was administered with the usual 2-hours-and-15-minutes time limit. 
Forty-five minutes were added for the Reasons-for-Action report. 

Friday afternoon was used for a critique and general discussion with 
the principals about their week’s work. The time required was usually 
short enough to permit the principals to leave the center by midafter- 
noon. 

The final portion of the program for the week was undertaken by 
members of the research staff. Each independently completed a socio- 
metric nomination form rating the top five and the bottom five principals 
on each of the following three criteria: 

1. If you were requested to select a principal for Whitman School on the 


basis of what you now know about each one, whom would you 
choose? 


2. Who among the principals was most popular with the others and 
seemed to get along best socially? 


3. Who among the principals did you like best? 


In this chapter the test week which was created to provide for the 
administration of standard tasks occurring within a simulated elementary 
school has been described briefly. two hundred and thirty-two principals 
were selected from 32 school districts located in widely separated sec- 
tions of the United States. These principals were tested at convenient 
test centers in groups of approximately 20. The participating school 
districts also provided information about each principal’s performance 
in his home school which included ratings of his performance by his 
teachers and by his superiors. 

The simulated school and community are described more fully in 
the two chapters which follow. Chapter 3 gives a detailed and qualita- 
tive description of Whitman School, the simulated school in which each 
of the 232 subjects of the study was asked to serve for a week as prin- 
cipal. Since differences in school situations are known to be large, it is 
important that the reader know the specific school situation used in the 
study. Chapter 4 describes the procedures used to structure the simu- 
lated school. 


Chapter 3 
THE SIMULATED SCHOOL 


IF YOU HAD BEEN ONE OF THE 232 PRINCIPALS WHO WERE THE PARTIC- 
ipants in the study, you would have overheard (by means of a tape 
recording) the following conversation between Patricia Lee, the full- 
time librarian at Whitman School, and Eleanor Blake, one of the fourth- 
grade teachers. They had just come into the teachers’ room and were 
talking about the news that Mr. Jarrett, the principal, was leaving. Their 
conversation reflects some of the problems that would have to be faced 
by Marion Smith, the new principal. 


PaT: Well, hi, Eleanor. You got down here before I did. 

ELEANOR: Yes, what do you think about Mr. Jarrett’s leaving? 

PaT: I was so surprised that I didn’t know what to do. 

ELEANOR: It'll be the second principal I’ve broken in in this school. You 
know I was here before he came. 

PaT: Oh, that’s right. You’ve been here—oh, dear. Well, I surely do hate 
to see him leave. 

ELEANOR: Well, I don’t know. I hope we get a principal this time who'll 
back up the teachers and not let the parents run the school. 

PaT: Oh, I think Mr. Jarrett has been very helpful. He has really helped me 
out. 

ELEANOR: Oh, he may be helpful, but the parents are running the school. Do 
you remember at Halloween—well, I guess it was two weeks before— 
when they brought in that UNICEF film? 

PAT: Well, I vaguely remember it. 

ELEANOR: It probably didn’t mix up your schedule like it did mine. On 
Monday morning that mother was there with the film. No advance warn- 
ing. And it had to go back at noon. So what do we do? We change 
our schedules. 
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PAT: Well, he gets things like that every now and then. He’s worked through 
a lot of things with me. You know, I have parents helping me in the 
library a half-day every day. They catalog and do clerical work and 
check books in and out and things like that for me, and it leaves me 
time to really work with the children. 

ELEANOR: It’s fine, if it relieves the teachers, but sometimes it puts on extra 
pressures. I certainly don’t like to have parents just popping in and 
disrupting a schedule at the drop of a hat. 

PAT: Yeah, but he doesn’t disrupt my schedule too much, I guess. But, you 
know, he’s so good about just providing time for you to come in and 
sit down and talk over problems. I feel like I can just walk in on him 
any time I have a real problem and he’ll take time to listen to it and 
help me think through what I’m really trying to do. 

ELEANOR: Well, I know he’s always there to talk to and maybe it’s the ther- 
apy that does you good because nothing happens afterwards. 


This chapter will attempt to provide the background for this con- 
versation and for the problems implied in it. Its purpose is to acquaint 
the reader with Whitman School, the school in which each of the 232 
subjects served as principal. 

Whitman School, along with the Jefferson community of which it is 
a part, constituted the setting for the week’s work of 232 Marion Smiths. 
To this setting each brought his unique personality and capabilities, his 
individual past experiences, and expectations. But it was the Jefferson 
community and, more particularly, the Whitman School that constituted 
the common base for them all. Here all were confronted with the same 
problems and all were provided with identical resources for coping with 
these problems. And it was within this setting that all displayed the 
administrative performance that this study attempts to understand. In 
this sense, then, the Whitman community may be viewed as the back- 
bone of the study. 

In order that the reader may better understand both the procedures 
and results of the study, this chapter describes the Whitman setting 
briefly—in fact, it presents much the same view that each Marion Smith 
was given in his early orientation. It starts with a general overview of 
suburban Jefferson, then moves on to a description of the Jefferson 
school district and its educational policies. The chapter next describes 
Whitman School itself, introducing the school’s vital statistics, and com- 
paring Whitman with the other Jefferson schools. Finally the chapter 
focuses on the Whitman faculty, the people with whom Marion Smith 
will interact most frequently. This chapter provides a survey of the fic- 
tional community and school that constituted the home and workplace 
of the 232 principals. To them Whitman was a real school for a week, 
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and Jefferson a real community. The next few pages are devoted to 
answering the question: What kind of a community is Jefferson? 


THE JEFFERSON COMMUNITY 


The general atmosphere of Jefferson Township, like that of many 
other suburban areas, is one of pleasant well-being. The streets are neat 
and well kept, the homes comfortable and in good repair. No apparent 
slum areas exist. Many of the community’s residents commute 20 miles 
to work in nearby Lake City. Many other residents earn their living 
locally as businessmen, professionals, small industrialists, and laborers. 

Like most communities of its kind Jefferson is highly organized. In 
addition to school-community groups, religious groups, and garden 
clubs, there are the usual number of lodges, service clubs, business and 
professional groups, and women’s clubs. Jefferson’s location near a 
large body of water affords many residents opportunities for boating. 
Country clubs provide further means for leisure-time activities. 

The standard of living of the residents of Jefferson is relatively high. 
Although there are a number of commuter families whose incomes fall 
within the $5000—-$8000 range, most of the commuters in the profes- 
sional and management groups earn from $15,000 to $50,000 a year. 
Professionals who work locally enjoy incomes larger than most people 
in the same professions elsewhere; and local merchants, along with their 
employees, receive better-than-average returns. 

The educational level of the community is also high. Well over half 
the population has been to college, and in recent years about three- 
quarters of the high school graduates have continued their education. 

Politically, the community is at least 70 per cent Republican, the 
Republicans traditionally winning most local elections. The residents 
seem generally well satisfied with their government. 

Somewhat atypical is the composition of Jefferson’s population in 
terms of national origins and religious groupings. Almost 10 per cent 
of its 28,000 are foreign born, about half of these having come from 
Italy. Among the native born, about 20 per cent are second-to-fifth- 
generation Italians. The largest religious group in the community is 
Roman Catholic. Protestants come next in order and are followed by 
Jews, who comprise about 15 per cent of the population. Five residents 
in every hundred are Negro. 

Also somewhat atypical is the governmental set-up of Jefferson. Al- 
though the district forms a single community educationally, three local 
governmental areas—Jefferson Village, Cedar Park Village, and an un- 
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incorporated area—exist within this school district, each providing its 
own fire, police, and recreational services. Despite good cooperation, 
this overlap in municipal administrative functions remains a source of 
potential conflict. 

Another source of potential conflict inheres in the differences be- 
tween these areas. Jefferson Village, settled earlier than Cedar Park, 
has always been a most closely knit community. Its residents, mostly 
middleclass workmen, have had a small-town orientation and a lower 
standard of living than have their more affluent neighbors. Almost all 
the Negroes and foreign-born residents of the Township live in Jeffer- 
son Village. Cedar Park, on the other hand, began as the home of 
wealthy people who left the crowded metropolis for the quiet woodlands 
and attractive lake front of Cedar Park in the late nineteenth century. 
Many of its old, lavishly conceived homes still stand. Cedar Park be- 
came the mecca for sailing enthusiasts, many of its beaches having been 
bought by private clubs. 

The differences between these areas, while having an effect on the 
school district, are nonetheless ameliorated by the very existence of that 
school district. Jefferson Township places great emphasis on education. 
The school district thus serves as a unifying force to tie together the dis- 
parate elements within the community. 

In 1957, Jefferson’s yearly expenditure for public schools was about 
$600 per pupil as compared with the national average of $244 per pupil. 
The schools’ equipment is plentiful and up to date; money for new addi- 
tions to the buildings has been voted with comparatively little difficulty. 
The relatively high salaries paid by Jefferson (the starting salary for an 
inexperienced teacher with a B.A. was $4,300) plus the good reputation 
enjoyed by the school district results in Jefferson having little difficulty 
in attracting and retaining good teachers. 

Jefferson’s location near a large city makes available to its students 
other resources. Lake City has several museums accessible to the chil- 
dren; another nearby city has recently initiated a museum workshop for 
school-age children. 

Perhaps of most importance in affecting the schools is the commu- 
nity’s great interest in education and its unusually close relationship with 
the schools. The Daily Record, Jefferson’s local newspaper, carries a 
considerable amount of school news and on occasion devotes whole 
pages to school affairs. Most mothers in the community are free from 
the necessity of working and can therefore spend a lot of time on the 
schools. All Jefferson’s schools have very active PTA groups. Parents 
are also quite active on the four elementary school health councils. Sev- 


30 ADMINISTRATIVE PERFORMANCE AND PERSONALITY 


eral of the mothers volunteer their services and work within the schools 
themselves. Whitman School, for example, enjoys the services of quali- 
fied mothers who teach elementary French in the lower grades. Other 
volunteers do clerical work in the library, which gives the librarian more 
time to work with the children. 

The people of Jefferson, well-educated themselves, strongly support 
the school district. The pressure they exert on their children to attend 
college tends to keep up the standards of Jefferson’s schools. From their 
great interest, however, stems the problem of parental interference. An- 
other problem created by this college-oriented community is that of 
properly educating those children who will not enter college. The chil- 
dren come from both sides of the track, and the needs of one group do 
not always coincide with those of the other. 


THE JEFFERSON TOWNSHIP SCHOOL DISTRICT 


To operate its schools, the Jefferson school district employs a pro- 
fessional staff of 260, including classroom teachers, special teachers, 
librarians, nurse-teachers, supervisors, principals, and central office ad- 
ministration. The administrative staff consists of 11 persons, nine men 
and two women, most of whom served some kind of apprenticeship in 
the system before being appointed to an administrative position. 

Perhaps the most outstanding aspect of the administration is the per- 
son of E. Andrew Donnelly, the Superintendent of Schools. No mere 
figurehead, he is powerful in both the schools and the community. He 
has been in Jefferson for almost 20 years and has taken a leading role in 
many of the developments that have given the schools their present 
status. He has willingly consented to surveys of the schools by outside 
agencies, not only because of a sense of pride in the district, but also be- 
cause of a desire to improve the schools through adoption of recommen- 
dations that might be made. 

The Assistant Superintendent for Instructional Services is responsi- 
ble for the instructional program. The creation of this post in 1954 has 
been a strong factor in speeding up the process of curriculum develop- 
ment. Mrs. Seward, the woman appointed, had been teacher and princi- 
pal in the school system for 16 years. She is one of the prime forces be- 
hind the continuing curriculum development within the school district. 
One principal has described her appointment as the most important 
change in the district in many years. 

Other administrative officers include the Assistant Superintendent 
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for Business Management and the six building principals. In addition, 
each of the two secondary schools has an Assistant Principal and a 
Counselor who is responsible for the guidance services of the school. 

The administrative officers are appointed annually by the Board of 
Education of the Jefferson Township School District. The Board is 
made up of six members, two elected each year for a three-year term. 
By informal local agreement, two members of the Board are chosen from 
each of the three areas of the district. Also by local agreement, no mem- 
ber serves more than two terms. This practice limits the possibility that 
an individual, through long continuance in office, might establish a 
vested interest. 

Candidates for the Board must be supported by a petition of not less 
than 25 qualified voters. In recent years, all candidates have been hand- 
picked by a self-perpetuating committee of lay citizens. This Committee 
for the Selection of School Board Nominees is made up of 24 residents 
of the school district, eight from each of the three sections of the com- 
munity. Members of this group review the qualifications of all proposed 
candidates and present their slate at an annual meeting. The candidates 
they present are almost always elected. This entire nomination proce- 
dure is informal and unofficial. The absence of any opposition and the 
obvious quality of the present Board members seem to reflect com- 
munity satisfaction with the working of the committee. 

During the school year, the Board meets twice each month. The 
first hour of each meeting is closed, attended only by Board members, 
some members of the schools’ professional staff, and the local reporter. 
Thereafter, many other members of the community, particularly PTA 
members, sit in on the meeting. Between meetings, there are many in- 
formal contacts between the Superintendent and the Board. 

On the morning following the first of the two monthly meetings of 
the Board, the “monthly principals’ meeting,” as it is called, is held in 
the office of the Superintendent. Attended by the district’s chief admin- 
istrators and the six building principals, the meeting affords the Superin- 
tendent an opportunity to refer certain matters to the group for their 
reactions and to review the Board meeting of the preceding evening. 
Most items in the principals’ meeting are raised by the Superintendent, 
and the discussion is led by him. The principals usually have little op- 
portunity to talk. 

About two weeks after the monthly principals’ meeting, the four 
elementary school principals usually meet alone with the Assistant Su- 
perintendent for Instructional Services to discuss matters pertaining to 
the elementary schools. In October of each year, the six school princi- 
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pals meet with the Board of Education to discuss the needs of their 
respective levels in the educational program. 

The Jefferson Township Teachers Association is the main vehicle 
through which the staff exercises its influence on school policy. This 
group cooperates with the Parent-Teacher Associations and the Board 
of Education in sponsoring an annual Community Institute for the dis- 
cussion of current issues. In recent years, the Association was rejuve- 
nated when the teachers’ salary crisis of the late forties gave the local 
teachers an issue around which to rally. The Association became their 
agent in negotiating salary increases with the Board of Education. 
Salary issues and related matters have continued to be among the prime 
concerns of the Teachers Association. 

In an organized fashion, the public shares in educational planning 
and policy making through three structures: the Committee for the 
Selection of School Board Nominees, the Parent-Teacher Associations 
of the six schools, and various ad hoc advisory committees. More in- 
formally, individual laymen may be invited from time to time to share 
in policy making, either as experts or as ordinary citizens. As in most 
communities, citizens may—and do—express their opinions on school 
matters without invitation. 

The activities of the Committee for the Selection of School Board 
Nominees have been mentioned earlier. Although this committee repre- 
sents one of the most important ways by which the people of Jefferson 
have an opportunity to influence school policy, it is through the six 
Parent-Teacher Associations that the general public is most closely re- 
lated to educational planning and policy making. Compared with an aver- 
age American school situation, the Jefferson PTA’s are unusually active 
organizations and their scope unusually wide. It was largely through the 
activities of the PTA’s, for example, that the school libraries were set 
up and staffed, and it is through their efforts that French is being taught 
in the elementary schools. Leadership positions in these groups carry 
high status in the community. Both formally and informally they have 
considerable impact upon the schools. Indeed, how much influence the 
PTA’s should have on the schools is one of the controversial issues dis- 
cussed by the school staff. 

The third way in which laymen become actively involved in plan- 
ning for the Jefferson schools is through lay advisory committees. There 
is no general, continuing lay advisory committee such as is found in 
some communities; but specific, temporary lay advisory committees are 
used from time to time. It was such a committee, for example, that was 
instrumental in developing the plans for the alterations and additions to 
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the junior high school building. That laymen have valuable contribu- 
tions to make to the program and operation of the schools is unques- 
tioned in Jefferson Township. 


EDUCATIONAL POLICIES AND PROCEDURES 


In general, one might say that Jefferson does not tend to pioneer in 
its curriculum, but instead follows national curricular trends promptly 
as they become apparent. Although there are a number of staff com- 
mittees at work on curriculum development, there is little evidence of 
the broken-front approach to curriculum improvement which encourages 
the individual teacher to experiment freely on his own initiative. In- 
deed, the impression gained is that more value is placed on conformity 
than on experimentation by staff members. 

It cannot be stated definitely that the school district is centralized or 
decentralized, for there seems to be a mixture of tendencies. The man- 
ner in which the principals’ meeting is planned and conducted, for 
example, can be viewed as a mark of centralization, since the Superintend- 
ent of Schools dominates the meeting. Centralization is similarly appar- 
ent in the dearth of intra-school committees in contrast with the numer- 
ous inter-school staff committees. The large number of system-wide rules 
that are given in the Staff Handbook suggests the value placed on cen- 
tralization. Further, all the elementary schools use the same report card. 

The method used for selecting new staff members, on the other hand, 
is much more decentralized than in many other school districts. The 
building principals in Jefferson apparently make the key decisions with 
respect to recommending new staff for employment. Likewise, in making 
recommendations concerning the tenure of staff members, the building 
principals usually make the key decisions. In other matters, too, the 
Superintendent often delegates authority and responsibility. On the issue 
of centralization vs. decentralization, the Jefferson system follows no 
consistent practice. 

One practice rigidly insisted upon by the Jefferson administrative 
staff, however, is that of the self-contained classroom. The classroom 
teachers are expected to be with their pupils at all times except for 
physical education periods. Jefferson makes wide use of consultants. 
Each elementary school has a librarian, a nurse, and consultants in art, 
reading, and home economics; and each elementary school has the part- 
time services of a psychologist and of consultants in arts and crafts, and 
in vocal and instrumental music. The consultants very seldom work 
alone with the children. The classroom teachers are expected to take 
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an active part in all the directed educational experiences of the children, 
the consultants functioning only as resource persons and only helping 
with activities where their specialized training is desired. Some of the 
older teachers are resentful of this arrangement and are openly out- 
spoken in their denunciation of the consultant arrangement and the self- 
contained classroom, which they view as an imposition upon their free- 
dom. This issue is another problem for the school. 

The curriculum of the Jefferson schools is constantly being evalu- 
ated, revised, and coordinated. PTA groups are actively engaged with 
groups of teachers in this process. Teacher committees are usually com- 
posed of teachers from several grades, so that there can be coordination 
of the child’s learning as he progresses through school. Within the past 
few years, curriculum guides for elementary school teachers have been 
formulated by committees of elementary school teachers working with 
curriculum specialists. These guides are now available in arithmetic, 
citizenship education, language arts, science, and art. Guides are being 
prepared in physical education, homemaking and crafts, music, speech, 
and library. Each guide lists grade placement of content and includes 
suggested problems, activities, and projects, as well as suggestions for 
correlating with other subject areas. 

The handicapped children of Jefferson are provided for in various 
ways. If they are confined to their homes, the system provides for home 
instruction. If they are able to attend school but require special training, 
they are sent to special schools in nearby districts at public expense. A 
special class is conducted at Whitman School for a group of children 
with [Q’s from 50 to 75. 

Similarly, Jefferson makes provisions for the gifted child. These in- 
clude the guidance of gifted pupils in selecting advanced reading ma- 
terials, the encouragement of art and music teachers to make special 
efforts to encourage gifted children in those fields, the formulation of 
special honors sections in mathematics and English in the high school, 
the offering of an in-service course on the gifted child, and the establish- 
ment of a faculty committee to work on improving education in this 
area. , 

The school district is fiscally independent of the municipal govern- 
ment. The Board of Education prepares its own budget and levies the 
school tax. In December of each year staff members are asked for assist- 
ance in developing the budget for the coming school year. Teachers re- 
quest items of supplies and instructional apparatus they will need for 
the coming year; the principals screen these requests and compile them 
for their school buildings. The list for each building and service depart- 


THE SIMULATED SCHOOL 35 


ment is sent to the central office, where the requests are reviewed by the 
Superintendent and his staff. The Superintendent’s total budget is pre- 
sented to the Board by March 1. The Board holds a hearing on the 
budget in May. Invitations to the hearing are issued to many com- 
munity groups and the public is invited to attend. Although attendance 
is not large, some of those present are representatives of their organiza- 
tions, so that many more people are represented than are present. 

During the hearing, each member of the Board explains a section of 
the preliminary budget to the people present. After the hearing the 
Board may leave the budget unchanged, or it may revise the figures 
downward or upward. After any such change, the Board formally ap- 
proves the final budget, which then becomes the basis for the next year’s 
school tax rate. 


THE WHITMAN SCHOOL 


Whitman School is one of four elementary schools of the Jefferson 
Township School District, in the state of Lafayette. The building was 
constructed in the early nineteen hundreds and has had a few additions 
since then. The three-story structure consists essentially of two buildings 
with connecting corridors. In addition to classrooms, it has a library, a 
music room, an art room, an industrial arts room, a kitchen, a teachers’ 
room, a Clinic, and a large gymnasium-auditorium. The school office is 
located in the center of the building. The entire building is neat and 
well kept, and its equipment is up to date and plentiful. 

Although the school building itself is adequate, many feel that the 
space surrounding the school is not. The playground area is somewhat 
cramped and the school’s facilities for parking are not sufficient. Whit- 
man’s location on a busy street creates an ever-present safety problem. 

In most ways, Whitman does not differ substantially from the other 
three elementary schools in the Jefferson school district. All four schools 
are governed by the same policies and follow the same curriculum 
guides. And all four range from kindergarten through sixth grade. Whit- 
man, however, has fewer classes than any of the other three schools (21 
regular classes, as compared with the 25, 26, and 29 classes of Long- 
fellow, Emerson, and Mark Twain, respectively). The mean number of 
students per class is also somewhat lower at Whitman. 

Despite the smaller classes, Whitman students do not achieve as 
well as do other students in the system. The Stanford Grade Placement 
Achievement Tests in reading, arithmetic, and spelling indicate that al- 
though the median scores of Whitman students are somewhat higher 
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than the national median, they are lower than those of the students at 
the three other Jefferson schools. 

More of Whitman’s pupils come from families of foreign extraction 
and from families with lower educational backgrounds than do the pupils 
of the other schools, and its pupils typically have had less prekinder- 
garten school experience. For all these reasons, Whitman is considered 
the least favored of Jefferson’s elementary schools. Although this prob- 
lem of Whitman being the “black sheep” of the school district has not be- 
come serious thus far, the potential danger is a matter of concern to the 
community’s educators. 


THE WHITMAN FACULTY 


The faculty of the Whitman School is certainly as able and well 
qualified as that of the other Jefferson schools. The faculty comprises 
20 regular classroom teachers, three in each grade (one through six) 
and two kindergarten teachers. There is, in addition, a teacher for the 
special class of retarded children. The faculty also includes two physical 
education teachers, a librarian, a nurse, a consultant in reading, one in 
art, and one in home economics. As mentioned earlier, the services of 
other consultants are shared by Whitman and the other elementary 
schools in the district. The principal, the school secretary, and three 
custodians complete the regular school staff. 

The principal is the official head of the school building. Beneath 
him, in formal organizational terms, is a grade chairman for each of the 
six grades. This office rotates annually among the three teachers in each 
grade. 

The faculty members range in age from recent college graduates to 
those near retirement. Roughly half are less than forty years of age. All 
but one of the regular classroom teachers are women; three of the four 
male full-time teachers serve as consultants. 

The educational level of the Whitman staff is unusually high. Every 
teacher possesses at least a bachelor’s degree and about half of the staff 
has earned a master’s degree or better. Many are continuing to take 
courses in nearby Lake City. 

The staff has had a considerable range in teaching experience. About 
one-third of the faculty has had teaching experience elsewhere within 
the Jefferson school system. A dozen or so have taught outside the sys- 
tem, their teaching experience having been largely limited to areas in or 
near Lafayette. One teacher at Whitman has been teaching there since 
1928. Several others arrived in the thirties or forties. About half of the 
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staff, on the other hand, started teaching at Whitman during the past 
decade, and a few of these have not yet attained tenure. 

The wide range in background, experience, and age of the staff mem- 
bers has its effect on their interaction with ch ether. There are very 
few all-faculty social get-togethers within the building faculty, such as 
faculty picnics or Christmas parties. Teachers of the same sex and ap- 
proximate age generally make up the informal social groupings in the 
faculty. Religious affiliation, marital status, and propinquity of class- 
rooms are other variables that influence group membership. Three dis- 
tinct patterns of schedule are present in Whitman School. The most 
rigid schedule is that of the two physical education teachers. They ar- 
rive at school at 9:00 A.M. The physical education program begins at 
9:00 and continues until just before lunch. During the lunch hour, the 
teachers are on duty supervising the children. The physical education 
teachers do not eat at the same time as the other teachers, but eat after 
the afternoon session has begun. The lunch-hour duties and after-school 
activities contribute to keeping these two teachers apart from the rest of 
the faculty. 

The regular classroom teachers are not as “tied down” by their 
schedules as the physical education instructors, but the fact that they 
must remain with their classes virtually all the time severely limits the 
amount of interaction they can have with each other during school hours. 

The most flexible schedule is that of the consultants. During the 
course of a school day, a consultant may visit many different classes. 
When not working with the children, he may have an informal confer- 
ence with a teacher. The consultant is almost never solely responsible 
for a group of children; when he is working with pupils, their regular 
classroom teacher is on hand and is responsible for them. His schedule 
is more flexible in consequence of his generally more varied program. 
The consultant interacts with a much larger number of teachers each 
day than does the regular classroom teacher. The consultants’ interac- 
tion in the work situation with teachers is greater than teachers’ inter- 
action with one another. 


INFORMAL INTERACTIONS AMONG WHITMAN 
FACULTY MEMBERS 


Since most of the Whitman faculty members are classroom teachers, 
not much opportunity exists for informal interaction during the school 
day. Nonetheless, there is evident, especially in the lunch and coffee 
periods, the development of relatively distinct subgroups, each drawn 
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together by such factors as age, marital status, and propinquity of class- 
rooms, as mentioned earlier, but particularly by their sentiments toward 
the following three major school issues: 


1. The performance of the former principal 
2. The consultant arrangement and the self-contained classroom 
3. Parental interaction with the school 


The chief division in the Whitman School is one between what might 
be called the ‘‘old guard” and the “new guard.” Six women classroom 
teachers, ranging in age from about fifty to their mid-sixties, form the 
core of the old guard. All six have taught in the Jefferson system for 
many years, and each has been at Whitman for at least 15 years. 

The old guard are consistent in their views about the three issues. 
In general, they are not opposed to the principal, Mr. Jarrett, but feel 
that he is “tied hand and foot” by what they consider to be the excessive 
power of the Superintendent. They are rather vehement in their de- 
nunciation of the consultant arrangement and the self-contained class- 
room, where they feel they are expected to play “mommy” all day. This 
group also feel resentment toward parental interference, and express 
the view that parents “run the school.” As one of them commented, 
“You can expect a parent to pop into the room at any time.” 

The new guard tend to have somewhat opposite views. In general, 
the younger members of the group support the principal; they feel that 
he backs up his teachers and is generally very helpful, although older 
members of the group tend to disagree. On the issue of parent inter- 
ference, the teachers of the new guard are split. Some view it as an im- 
position and as interfering with their work, while others feel that the 
parents are of great help to them. The younger members of the new 
guard are enthusiastic about the consultant arrangement and the self- 
contained classroom; the sentiments of the older members in this re- 
gard are similar, although they have some reservations. 

One might conclude that the new guard, with a few exceptions, gen- 
erally support the status quo. The old guard, remembering the teaching 
situation as it was in their earlier days, tend to be resentful of many of 
the relatively recent developments at Whitman. 


Chapter 4, 
STRUCTURING WHITMAN SCHOOL 


THE WHITMAN ELEMENTARY SCHOOL OF THE JEFFERSON SCHOOL DIs- 
trict in the State of Lafayette constitutes the simulated locale for the 
study. Whitman School, as the description in Chapter 3 demonstrates, 
has a very definite character. Its ancestry is somewhat paradoxical, for 
it is both partly real and partly fictional. This chapter describes how 
Whitman School and its problems came into existence. 


SELECTION OF A BACKGROUND SCHOOL 


The invention of a mythical school, with all its complexity of detail 
and with the necessity for consistency among these details, is obviously 
not a simple undertaking. It was therefore decided to adapt a description 
of a real school and community to the purposes of the study. The first 
step was to set up criteria to guide a search for an actual school which 
could be used as the prototype of Whitman School. The following 
criteria were established: 


1. The school should provide a possibility for presenting a wide range of 

typical problems. At a more detailed level: 

a. The school should be located within a system having more than one 
school building. 

b. The community should contain families from a variety of socioeco- 
nomic backgrounds. 

c. The school system should participate fully in state and federal pro- 
grams. 

d. The community should be one which is growing in population with a 
school building program in progress. 
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e. The population of the community should be heterogeneous with re- 
spect to religions. 
f. Many members of the community should participate actively in edu- 
cational issues. 
. The community should be a relatively autonomous unit, 1e., not a 
suburb of a large city. 
. The community should be urban rather than rural. 
The population should be in excess of 20,000. 
The school district itself should be at least a semi-autonomous unit. 
. The school should be so located as to include problems of pupil trans- 
portation. 
1. The organization of the school system should be relatively “flat,” with 
few levels of authority structure. 
m. The school should be only a reasonably good school. 


Sa mae le 
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. Convenience should be considered: 


a. The system should be readily accessible to the research staff at both the 
Educational Testing Service in Princeton, New Jersey, and at Teachers 
College, Columbia University, New York City. 

b. The community should be relatively easy to disguise, with no extremely 
distinctive features. 

c. The school system should be one which had been surveyed within the 
last few years, in order to avoid the necessity of repeating this work. 


3. Research staff members should have full freedom to observe and ask 
questions: 


a. The Board of Education, chief school administrative officer, and school 
staff should be willing to participate in the study and to cooperate with 
the research staff. 

b. There should be no focal community conflicts. 

c. Members of the school staff should have a relatively high level of 
morale and a feeling of security in the system and school. 


Needless to say, a school district which met all the criteria was not 
found. It was, however, possible to secure the cooperation of one which 
met all but two of the criteria. The school district selected failed to meet 
the criteria of not being a suburb of a metropolitan area, and having a 
pupil transportation system. Some thought was given to superimposing 
a transportation system on the original structure, but it became apparent 
that this one change would require many other changes which might 
jeopardize the consistency of the entire situation. Though the school 
district had been recently surveyed, some survey work was repeated in 
order to provide supplementary and up-to-date information. The orig- 
inal survey provided much useful background information. 

The identity of the particular school selected will not be revealed. 
Whitman School is not identical with the prototype school, since many 
hypothetical problems and issues not actually present in the real school 
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system were introduced. Names and places were disguised, but the gen- 
eral features of the school district were held intact. Only one of the 232 
principals who were the subjects in the study identified the prototype 
school, and he had formerly taught in the district. 


PREPARATION OF BACKGROUND MATERIALS 


The materials constructed to create Whitman School may be divided 
into two major categories: 


1. Those presented during the first day and a half of the test week 
for the purpose of acquainting the subjects with the school and com- 
munity are called background materials. 

2. Those used to present the standard set of administrative problems 
upon which the principals were to work during the test week are called 
test materials. 


FILMSTRIP 


A filmstrip of 93 frames was made by selecting and arranging 35 
mm. color photographs taken by staff members in the prototype com- 
munity. A tape-recorded commentary accompanied the filmstrip. Com- 
ments resembled those that might be made by a well-informed resident 
as he conducted a tour of the town. The filmstrip included a map of the 
school district with the route of the tour clearly indicated. It provided 
a general “first impression” introduction to Whitman School and to the 
commercial, recreational, and residential areas of Jefferson. 


SCHOOL COMMUNITY SURVEY 


Although the background community had been surveyed five years 
before the study began, it soon became apparent that a supplementary 
survey would have to be made. During the summer of 1957, staff mem- 
bers secured permission to gather the necessary information, and several 
weeks were spent in making the survey. 

The survey staff interviewed teachers, principals, assistant superin- 
tendents, the superintendent of schools, and board members, as well as 
such community leaders as the president of the League of Women 
Voters, the editor and school reporter for the local newspaper, the 
mayor, and other political leaders. Publications of the League of 
Women Voters and the Chamber of Commerce and of the school system 
were obtained, as well as minutes of the Board of Education meetings. 
Staff members observed and took notes at meetings of the school board, 
the PTA, the faculty, the principals, and faculty committees. Later, 
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similar meetings and interviews were tape recorded for use in portraying 
parts of the background and as test materials. To get a fuller flavor of 
the community, surveyors talked with many of its citizens, ate in its 
restaurants, and took part in some of its activities. 

The resulting Jefferson School-Community Survey has two major 
parts. Part I includes a general description of the community, its his- 
torical, political, economic, and social setting. Part II consists of a gen- 
eral description of the school system, its organization, the instructional 
program, major administrative functions, and its problems. 

Except for minor editorial changes for purposes of securing anonym- 
ity, the Jefferson School-Community Survey is an actual survey of the 
prototype school district—with the same wording, tables, charts, and 
maps. 


MOTION PICTURE 


“You Will Enjoy Teaching in Jefferson Schools” was a sound mo- 
tion picture made by a member of the research staff who is an amateur 
photographer. It purports to be a film which was prepared by a teacher 
at the request of the Jefferson Teachers Association, and financed by 
the board; its purpose is to acquaint prospective teachers with the school 
system and community of Jefferson. This 45-minute color sound film 
provides a means for Marion Smith to gain a more intimate view of his 
new job, to meet some of his associates, and to see some of his teachers 
at work. 

Most of the picture was taken inside the prototype of Whitman 
School. It shows the principal’s office, his secretary, teachers, parents, 
and students. The viewer visits a second grade, where he observes a 
reading group and watches children learning fractions by measuring the 
ingredients for Halloween cupcakes. A visit to the fifth grade during a 
“show and tell” period and a view of pupils during the lunch hour allow 
him to form more impressions. Later the viewer tours some of the 
classrooms and special-purpose rooms of the school, watches the chil- 
dren leave school for home, and observes a parents’ study group and a 
teachers’ meeting after school. As the film ends, he sees streams of 
commuters returning from the city. 

Three full days were spent in the school and community exposing 
about 1,500 feet of 16 mm. color film—600 feet of outdoor scenes and 
900 feet of indoor scenes. Notes taken as the film was exposed later 
served as resource material for the production of a sound track. Use of 
a very fast indoor color film obviated the need for photoflood lamps and 
allowed the photographer to take natural close-ups of students and 
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teachers. In contrast with the filmstrip, this film emphasized such items 
as the internal working of the school, personalities, methods of instruc- 
tion, building layout, and pupil activities. 

Working from a script based on a viewing of the complete final copy 
of the film and on the notes, a magnetic sound track was prepared. Ac- 
tual voices of members of the school staff and sounds recorded in the 
classrooms were used where possible. 

Providing anonymity throughout the movie required considerable 
care. In order to reduce the likelihood that the real Jefferson would be 
identified, pictures of automobile license plates and of state highway 
signs were eliminated and the picture of the railroad station was under- 
exposed (creating the effect of evening) in order to hide the name of the 
town and of the railroad. 


WHITMAN FACULTY STUDY 

A document called A Study of the Whitman School Faculty and a 
complete set of faculty personnel records were prepared to acquaint the 
principals with the personnel of the school. The faculty study provides 
a detailed account of the informal relations among members of the fac- 
ulty and their attitudes concerning the school. This study of the faculty 
was presented as the work of an advanced graduate student from La- 
fayette State University; it examines the informal social activities at Whit- 
man School in terms of certain of the concepts developed by Homans.} 

The data reported in A Study of the Whitman School Faculty were 
collected by direct observation, interviewing people in Whitman, and 
examining such materials as teachers’ schedules and publications on 
school policy.2, The report consists of descriptions of the typical se- 
quences of activities at the school and of the informal groups within the 
faculty. It also presents the attitudes of the teachers as evidenced by 
their opinions on four major issues: 


. Is the concept of the self-contained classroom acceptable or not? 

. What is the attitude of classroom teachers toward consultants? 

. To what degree does the principal, Mr. Jarrett, back up his teachers? 

. What is the degree of parental influence in the school? Is it increas- 
ing? Are teachers for or against it? 
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+ George C. Homans, The Human Group (New York: Harcourt, Brace and 
Company, 1950). 

*Laurence Iannaccone, The Social System of an Elementary School Staff. 
Unpublished Ed.D. Project, Teachers College, Columbia University, 1958, 171 
pp. For a complete report of this study see Daniel E. Griffiths, David Clark, 
Richard Wynn, and Laurence Iannaccone, Organizing Schools for Effective Educa- 
tion (Danville, Illinois: The Interstate, 1961). 
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A series of interviews with teachers was conducted, and direct ob- 
servation was made of groups of teachers in free settings, such as at 
lunch, at coffee breaks, and after the children had left. The observer 
joined as a participant in many of these activities, spending several 
weeks in the prototype school. 

The faculty study also used recorded data, such as the teachers’ 
handbooks, minutes of faculty meetings, committee reports, and various 
school publications. Three regular school board meetings, as well as 
meetings of committees and the administrative cabinet, were attended by 
the observer. 

The personnel files of Whitman teachers were based on data for the 
real faculty of the prototype school, and contained objective data on 
each member, including such items as age, marital status, dependents, 
education, and years of experience in teaching. The names of individuals 
were, of course, changed to prevent identification. 


HANDBOOKS 


Reference materials in the form of three official handbooks were 
prepared. These included the Jefferson Staff Handbook, the Board State- 
ment of Policies and By-laws, and the Law Digest. 

The Jefferson Staff Handbook was an adaptation of a small, 31-page 
statement of rules, regulations, resolutions, policies, and procedures that 
had evolved in the prototype school system. The handbook was intended 
to help new teachers become acquainted with procedures used in the Jef- 
ferson system and to be a useful reference for all staff members. Its 
contents include a statement of the philosophy of education of the Jef- 
ferson Township public schools and sections on organization, teacher 
personnel policies, classroom and school activities, budget requests, ma- 
terials of instruction, and professional improvement. The original hand- 
book was edited only to maintain anonymity. The Board Statement of 
Policies and By-laws is similarly a replica of that in use in the back- 
ground school system. 

The development of a law digest presented more of a problem than 
did the two other handbooks, since no such document existed in the pro- 
totype school. It was decided that the school laws of the state of La- 
fayette should not be modeled after those of any one state, in order that 
no examinee have an advantage. Therefore, it was necessary to compile 
a school code, one which would be typical of many states but which 
would closely resemble the school law of none. 

In September 1957, two professors of school law were asked to 
compile the Experimental Edition of Excerpts from the School Code of 
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Lafayette, which was planned as a facsimile of the kind of document 
some states provide their school administrators. Ostensibly compiled by 
the Assistant State Superintendent of Education for Law and printed by 
the State Printing Office, Capitol City, Lafayette, the purpose of the 
booklet was to simplify the task of referring to the law and to make 
significant parts of the school law easily available. 

In preparing this booklet, the school codes of 48 states were used as 
source materials. From various statutes elements of the law such as 
those a principal might find in his state code and that he might need in 
the day-to-day operation of his school were selected. Actual wording of 
the original statutes, with annotations, was used to provide more real- 
ism. Every law used appears in the statutes of some state, in an essen- 
tially similar form. Care was taken to preserve a number of gaps, in- 
consistencies, and vaguely stated laws, such as are often found in a 
school code. Where appropriate, the law was made consistent with the 
Board Statement of Policies and By-laws and with the Jefferson Staff 
Handbook. The document includes a certification of authenticity by the 
Secretary of State of Lafayette and the State constitutional provision for 
the establishment of free schools, as well as excerpts from the school code 
of the State of Lafayette. There are chapters on general provisions, pu- 
pils, courses of study, textbooks and supplies, teachers, and school build- 
ings and property. A detailed table of contents was furnished. 


ADDITIONAL BACKGROUND MATERIALS 


As the principals became more familiar with Jefferson and the Whit- 
man School, background materials of a more detailed nature were pro- 
vided for study. Among these materials were a report of achievement 
test scores, a floor plan of Whitman, a copy of the school census, a class- 
size list, a staff roster, and a school calendar, all adapted from existing 
documents. 


BACKGROUND TAPES 


Another phase of each principal’s orientation to his new job in- 
cluded “overhearing” three incidents which conveyed information for 
his later use. 

The first taped episode was the conversation in the teachers’ room 
between Eleanor Blake, a fourth-grade teacher, and Patricia Lee, the 
school librarian, part of which is presented at the beginning of Chapter 
3. Two experienced teachers played these roles, and worked from a 
general outline of the topic, not from a script. 

The second episode consisted of comments made at a PTA meeting 
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on ‘How Can Our School Be Improved?” The panel member, speaking 
on “Some Shortcomings of Whitman School from the Point of View of a 
Parent,” was the mother of a second-grader. She was active in com- 
munity affairs and had been on many PTA committees. She was speak- 
ing of her own child’s school. 

In the third incident, Dr. Donnelly, the Superintendent of Schools, 
had called a meeting of his principals on the morning after a meeting of 
the Board of Education. In the recording the Superintendent reviews 
for his principals the topics discussed at the board meeting. This record- 
ing was made at an actual meeting of the Superintendent with his princi- 
pals in the prototype school system. 


PREPARATION OF ADMINISTRATIVE TASKS 


After his orientation to Whitman School, Marion Smith began work 
on a wide variety of administrative tasks. Many of these were posed by 
items placed in the three in-basket tests, the nature and development of 
which will now be described. 


DEVELOPMENT OF IN-BASKET TESTS 


An in-basket test may be thought of as a job sample test of ad- 
ministrative performance. The main feature of the test is the presenta- 
tion of realistic problems in such a way as to elicit responses which fall 
within the realm of administrative behavior. Records of these responses 
provide a basis for assessing the various qualities an individual displays 
in his administrative decisions and actions. 

Selecting the administrative problems to be considered is an impor- 
tant step in building an in-basket test. The extent to which it may be 
possible to generalize from the analysis of in-basket behavior to adminis- 
trative behavior on the job depends largely on whether the problems 
presented represent significant problems encountered in real-life admin- 
istration. 

Development of the in-basket test materials involved (1) analysis of 
the job of the elementary principal; (2) identification of administrative 
problems; (3) development of specific incidents based on problems; and 
(4) development of items from incidents. 

Analysis of the job. Griffiths, as part of a study entitled Coopera- 
tive Development of Public School Administration in New York State, 


* This analysis has been found useful in preparing job descriptions for the 
various administrative positions in public education, published in the series, Your 
School and Staffing, and including the following pamphlets: The School Business 
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brought together two analytical frameworks developed by Livingston 
and Davies* and Katz> to form a conceptual scheme for describing the 
work of school administrators. According to Livingston and Davies, 
the job divides into four major parts: 

(1) improving educational opportunity; (2) obtaining and devel- 
oping personnel; (3) maintaining effective interrelationships with the 
community; and (4) providing and maintaining funds and facilities. 

Katz developed the three-skill approach to the analysis of the work 
of an administrator. His emphasis was on what a man does in an ad- 
ministrative position. The three skills and their relevance to the elemen- 
tary school principalship are as follows: 

1. Technical skill involves specialized knowledge and ability, including the 


methods, processes, procedures, or techniques that the principal would 
need in order to carry out his duties as principal. 


2. Human skill involves ability to work effectively as a group member and 
to build cooperative effort within the faculty which he heads; it may be 
contrasted with technical skill—working with people versus working with 
things. 


3. Conceptual skill involves ability to see the organization as a whole; it in- 
cludes recognizing the interdependence of each unit and how changes in 
one unit affect all other units. 


These two schemes were put together so as to form a grid with the 
four areas of content on the vertical axis and the three skills of adminis- 
tration on the horizontal axis. The resulting grid is shown below: 


‘TECHNICAL HUMAN CONCEPTUAL 


(T) (H) (C) 
Educational program (E) ET EH EC 
Developing personnel (P) PT PH PC 
Community relationships (R) RT RH RC 
Maintaining funds and facilities (F) FT FH FC 


Administrator, The Elementary School Principal and Director, Instruction Staff 
Administrator, and Secondary School Principalship (Albany: New York State 
Teachers Association, 1955). 

*A Developing Concept of the Superintendency of Education, Cooperative 
Development of Public School Administration (Albany: New York State Teachers 
Association, 1955). 

> Robert L. Katz, “Skills of an Effective Administrator,” Harvard Business 
Review, Vol. 33, No. 1, January—February 1955, pp. 33-42. 

* Daniel E. Griffiths, Human Relations in School Administration (New York: 
Appleton-Century-Crofts, Inc., 1956), Ch. 1. 
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The twelve cells of the grid provide twelve categories by which to or- 
ganize the various aspects of the job of the elementary school principal." 
Identification of problems. For purposes of this discussion, a prob- 
lem is any situation which is viewed as being less than satisfactory. For 
example, the lack of a plan for a continuing program of public relations, 
or a constant decrease in the extent of PTA participation in school 
affairs, would probably be seen as an unsatisfactory state of affairs by 
most principals, and, hence, for them each would present a problem. 

Ideas for problems for use in planning in-basket test items were 
obtained from many sources. The Harvard Graduate School of Educa- 
tion, the University of Kansas, Ohio University, and Teachers College, 
Columbia University, provided a voluminous file of case studies. For 
a period of several months the local newspaper from the prototype com- 
munity was read, and all articles dealing with the schools and with edu- 
cation generally were clipped. Staff members visited several school sys- 
tems to observe principals in action and to collect materials. Forms, 
printed materials, reports, and similar documents were gathered as pos- 
sible sources of suggestions for in-basket problems. 

Ideas for problems were systematically organized in a loose-leaf 
notebook known as the problem book and were classified under each of 
the 12 cells of the grid shown above. 

Development of incidents based on problems. An “incident” is a 
description of a specific occurrence of a problem, in concrete terms. For 
example, under the problem referred to earlier—that posed by the lack 
of a continuing program of public relations—an incident might be as 
follows: A local radio station volunteered to contribute 15 minutes of air 
time weekly to the school system as a community service, and a plan 
must be made if the time is to be used. Under the problem created by a 
constant decrease in PTA participation in school affairs, an incident 
might be this: The PTA voted to make the school library its project for 
the new school year, but it has not been able to get started. For each 
problem in the problem book, one or more “incidents” were created 
which were useful as concrete statements of problems and suggested the 
nature of actual in-basket items. 

Development of items from incidents. An “item” is the actual 
document that presents the incident in the in-basket test. For example, 
stemming from the above public relations problem and incident, Marion 
Smith might find in his in-basket a memo from the Superintendent ask- 
ing that the local radio station’s proposal to contribute free air time be 


“For a more complete discussion of the analytical framework see Griffiths, 
op. cit. 
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considered, pro and con, and that a summary of Smith’s views on the 
question be prepared for the next meeting of the Superintendent’s ad- 
visory council. For the second example, the in-basket item might be a 
file copy of last year’s PTA minutes showing the result of the vote, at- 
tached to the carbon copy of a note from Mr. Jarrett (the previous prin- 
cipal) to the PTA president offering to prepare some practical sugges- 
tions for their library project. 

Many more items were prepared, in draft form, than were needed 
for the three in-baskets. Between three and four hundred items were 
written, of which 96 were finally used in the three school in-baskets. In 
choosing the items, it was necessary to face the question of how many 
items should be chosen to represent each of the 12 cells of the grid by 
which the principal’s job had been analyzed. An advisory group com- 
posed of school principals and administrators was asked to consider the 
importance of each of the 12 cells and recommend the proportion of 
items which should be chosen for each area. Their recommendations 
resulted in the following distribution of the 96 items in the 12 cells: 


TECHNICAL HUMAN CONCEPTUAL TOTAL 


(T) (H) (C) 
Educational program (E) 4 6 6 19 
Developing personnel (P) 9 Ue 8 39 
Community relationships (R) 2) 1 6 26 
Maintaining funds and 
facilities (F) 6 3 5 12 
Total 27 46 23 96 


Figure 2 presents in summary form the illustrations just described, 
gives examples of problems and incidents, and describes the items de- 
veloped for one cell of the grid. 


DESCRIPTION OF IN-BASKET ITEMS 


A brief description of each of the 96 items in the three in-baskets 
follows, classified according to the 12 cells of the grid. The letter A, C, 
or D at the left indicates which in-basket contains the item, and the 
number shows the position of the item in that in-basket. 


CELL ET: Educational Program—Technical Problems 

A-24 Letter from a college professor requesting permission to use students 
of Whitman School in a psychological experiment. 

A-26 Memo from the Assistant Superintendent for Instructional Services 
concerning procedures for parent conferences. 


Educational program (E) 
Developing personnel (P) 
Community relationships (R) 
Maintaining funds and facilities (F) 


TECHNICAL HUMAN CONCEPTUAL 
(T) 
Area ET Area EH Area EC 
Area PT Area PH 
Area RT Area RH. 
Area FT Area FH 


(H) (C) 


Area PC 


Area FC 


PROBLEM 1 


The lack of a plan for a continuing 
program of public relations 


Incident 1 


Local radio station has volunteered 
to contribute 15 minutes of air 
time weekly to the school system 
as a community service 


Item I 


Marion Smith receives a memo 
from the superintendent asking 
that such a proposal be considered, 


pro and con, and that a summary 
of his views on the question be pre- 
pared for the next meeting of the 
superintendent’s advisory council 


SPECIFIC AREA RC 


Maintaining effective relationships with the 
community, at the conceptual level 


PROBLEM 2 


A decrease in the extent of PTA 
participation in school affairs 


Incident 2 


PTA voted to make the school 
library its project for the new 
school year 


Item 2 


In the file there is a copy of last 
year’s minutes indicating the result 
of the PTA vote and noting the 
fact that Jarrett had offered to 
prepare some practical guides to 
help the activity become a useful 
supplement to the school program 


FIGURE 2. Paradigm showing development of in-basket test items 
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A-27 
D-7 
D-10 


D-12 
D-26 
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Report from a doctor concerning tests he has administered to a 
Whitman student. 


Memo from secretary reporting a request by a teacher that a con- 
gressman who is to visit her class today speak to the school. 


Staff newsletter containing the test schedule for the year. 
Requisition for supplies, including request for gold and silver stars. 
Memo from the Superintendent in regard to Fire Prevention Week. 


CELL EH: Educational Program—Human Problems 


C—3a 
C-—23 


C-24 


C25 


C26 
D-14 


Mother wants to discuss daughter’s school problems with principal. 


Memo from a teacher concerning a student unable to do class work. 
Scores on the Stanford Achievement Test for whole class is attached. 


Memo from teacher attached to letter from mother regarding home 
teaching for convalescing daughter. 


Note from teacher protesting the methods of teaching fractions used 
by homemaking teacher. 


A bundle of six report cards. 
Transfer record of a Whitman student. 


CELL EC: Educational Program—Conceptual Problems 


A-32 


C-19 


D-8 


D-19 


D-23 


D-24 


Report of the Committee on Study Habits of Jefferson School Dis- 
trict Students. 

Memo from Assistant Superintendent for Instructional Services re- 
garding the report of a committee studying changes in the mathe- 
matics and science offerings. 

A memo asking reactions to the above report (dated two months 
later than above memo). 

Report on a program of outdoor education with memo by teacher 
suggesting that similar program be instituted at Jefferson. 
Recommendations of the Jefferson Committee on the Education of 
the Gifted. 

Note from teacher suggesting program for orienting sixth-grade stu- 
dents to the junior high school. 


CELL PT: Developing Personnel—Technical Problems 


A=1 


Telegram from teacher indicating that she is ill and will be absent 
the first week of school. 


Memo from Superintendent regarding faculty meetings prior to the 
first day of school. 


Memo from Assistant Superintendent for Instructional Services re- 
garding a meeting of new teachers. 


Memo from Superintendent regarding bicycle riding. 

Letter from doctor asking that student be given a half hour rest each 
morning and afternoon. 

Memo from Assistant Superintendent for Instructional Services re- 
garding practice teachers, 


aye 


C-15 
C-l7 


D-4 
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Four letters written by teachers for Marion Smith’s signature. 


Confidential memo from Superintendent concerning a civil defense 
drill. 
Report of absence of a teacher. 


CELL PH: Developing Personnel—Human Problems 


A-2 
A-4 
A-6 


D-15 


Note from secretary indicating she had done as requested. 
Note from janitor regarding open doors. 


Letter from Superintendent asking cooperation in encouraging 
teachers to join Jefferson Teachers Association. 

“While you were out” form asking Marion Smith to call Mrs. 
Donnelly. 

Letter from a former Whitman student offering her services. Memo 
from Superintendent attached; he recommends her. 


Personal letter from Assistant Superintendent for Instructional 
Services stating her secretary has resigned and she is offering job 
to Marion Smith’s secretary. 


Note from secretary indicating she is ill and has gone home. 


Janitor caught four boys smoking in the boys’ toilet and teachers 
are looking to the principal for disciplinary action. 


Two teachers report trouble brewing with the mother of two boys. 
Boy sent to office for picking fights with younger boys on playground. 


Letter from teacher of retarded children complaining about actions 
of other students toward her children. 


Notice encouraging teachers to use teaching aids and note to 
principal asking his reaction. 


Letter from teacher reporting money stolen from her desk and 
accusing a student. 


Note from music teacher complaining that a teacher always sends 
students to him late. 


Memo from secretary reporting that a teacher is very disturbed be- 
cause of a difference of opinion with a parent. 


Memo from secretary stating that a Whitman teacher had been in- 
vited to speak at NEA meeting. 


Letter from teacher complaining that she was being deprived of use 
of school facilities. 


Memo from secretary reporting a teacher in the hospital. 


Memo from Superintendent requesting that principals gather data on 
outside employment of teachers. 


A batch of data on a student who is having difficulty in gym classes. 
Taped situation—Secretary tells the principal that a child has 
vomited. The teacher can’t find the janitor; what shall she do? 


Request of parent to allow child to leave school early and an 
attached memo from teacher opposing request. 
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CELL PC: Developing Personnel—Conceptual Problems 


A-11 


A-28 
A-29 
C-32 


C-4 
D-18 
D-13 


D-31 


Letter from Superintendent asking Marion Smith to prepare a list of 
duties; attached is the list of the previous principal. 


An application from a teacher for a sabbatical leave. 
A staff newsletter announcing in-service courses for teachers. 


The secretary reports that certain teachers are not checking their 
mailboxes and she suggests a memo to all teachers to remedy this 
oversight. 


A letter of application for a teaching position at Whitman. 

Teacher’s request for a statement to a placement agency. 

Memo from the Superintendent to elementary school principals re- 
garding ideas as to advisability of employing assistant principals. 


A questionnaire from a doctoral candidate on the subject of principal 
perceptions of superintendents. 


CELL RT: Community Relationships—Technical Problems 


A-8 

A-13 
A-15 
A-19 


Cal 


“While you were out” form indicating a visitor from the state uni- 
versity will arrive shortly. 


Draft of a letter to parents prepared by kindergarten teachers. 
PTA membership forms left at office by membership chairman. 


Memo from secretary attached to Bulletin to Parents prepared by 
previous principal. 


Letter from graduate student who wishes to visit Whitman School. 


CELL RH: Community Relationships—Human Problems 


A-9 
A-10 


A-20 
C-28 
C-6 


C8 


C-10 


Note from minister welcoming Marion Smith to the community. 


“While you were out” form indicating a representative of the press 
had called. 


Letter from woman living near Whitman telling the principal to keep 
children off her property. 


A letter from a mother who is concerned because teacher has recom- 
mended that daughter see the school psychologist. 

Complaint of parent concerning temperament of a Whitman teacher. 
A letter from a parent protesting that her child is deprived of use of 
library because her class is scheduled during released-time period. 
Secretary has attached library schedule to letter. 


Letter from citizen protesting a letter to editor of local paper written 
by Whitman teacher. 


Letter from a father who feels the school is undermining his efforts 
to instill social graces in his children. 


Letter from a mother protesting the lack of doors on toilets at 
Whitman. 


Letter from a mother complaining that her child’s class is not 
progressing as fast as other classes. 
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D-9 Memo from secretary stating that a merchant has called reporting 
that children have damaged two pails. 

D-20 Taped situation—Secretary reports that the fire hydrant has broken 
just minutes before a fire drill is scheduled. She also says that a 
woman is in the office and wants to take a boy out of school. She 
says she is a neighbor of the boy’s mother; the mother has had an 
accident and wants to see her son. 


D-21 Memo from Superintendent urging principals to encourage full staff 
participation in the Community Chest Drive. 

D-22 Letter from a mother protesting lack of shower-bath facilities at 
Whitman. 

D-27 Letter from teacher reporting on a parent complaint. 


CELL RC: Community Relationships—Conceptual Problems 


A-16 Letter from the chairman of the League of Women Voters program 
committee inviting Marion Smith to speak on school facilities. 


A-18 Report of a PTA meeting indicating that Whitman School Library 
is to be their project for the current year. 


A-22 Note from PTA committee requesting suggestions. 
A-31 Announcement of after-school workshops in art, science, and nature. 
D-11 Invitation to be a discussion leader at a PTA meeting. 


D-29 Newsclipping reporting that a local minister says the schools are 
teaching atheism. Attached is a memo from the Superintendent. 


CELL FT: Maintaining Funds and Facilities—Technical Problems 

A-—5 Memo from the Assistant Superintendent for Business Management 
reporting a delay in receiving pencils. 

A-25 <Acopy of the 1957-1958 PTA budget. 

A-39 A bundle of forms used at Whitman School. 

A-33 An advertisement for instructional materials. 

C-21 Copies of budget request forms. 

D-25 “Requisition for supplies” form for principal’s approval. 


CELL FH: Maintaining Funds and Facilities—Human Problems 
C-29 Janitor wants memo sent to teachers telling them to keep school 
clean. 


D-16 Memo from the Assistant Superintendent for Instructional Services 
concerning the use of forms for parent conferences. 


D-17 Note from music teacher reporting a broken violin for which parents 
will not pay. 


CELL FC: Maintaining Funds and Facilities—Conceptual Problems 


A-14 Two clippings giving increased population figures with a memo from 
the Superintendent. 

D-28 Telegram from photographer who requests permission to take 
pictures of Whitman students. 
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D-30 Announcement of free copies of the Constitution of the United 
States obtainable from a distilling company. 


The fourth in-basket, the Bureau of Business In-Basket, was de- 
veloped independently, in connection with research done by Educational 
Testing Service with support from the Office of Naval Research. This 
in-basket is described in a report of a portion of that research.*® 


REALISM OF IN-BASKET ITEMS 


In many cases it was possible to add to the realism of problems in- 
volved in the in-basket test by interrelating items and then relating them 
to background material. 

For example, Item C—6 in the December in-basket was a letter to 
Marion Smith from Norman E. Richards. The letter expressed dis- 
turbance over what his son reported of his days at school and suggested 
that Mrs. Duval was temperamentally unsuited to her position as first- 
grade teacher, since the classroom atmosphere was one of tension rather 
than relaxation. Item C—5 was a note from Shirley Ostenberg, teacher of 
a special class at Whitman, requesting that something be done about the 
actions of some of the regular pupils toward the children in her class. 
She reported that hardly a day went by without tears brought on by the 
teasing of the other children, especially first-graders, whose actions she 
thought stemmed largely from the attitudes of Mrs. Nasca and Mrs. 
Duval. Item C—30, a memo to Marion Smith from his secretary, Ruth 
Platz, included the following paragraph: 


Mrs. Blake and Mrs. Duval were in to complain about the Knowl boys’ 
mother. She had been in to “visit” their classrooms today for the third time 
in a week. They’re very unhappy about all the interference. Mrs. Knowl 
herself stopped by on her way out to make some suggestions about the way 
the two grades are being handled. Looks like a storm is brewing. 


From his personnel records, Marion Smith could learn that Denise 
Duval was certified in special education and had taught a special class 
at Longfellow School for 22 years. Since 1944 she had taught first 
grade at Whitman. The only available end-of-year report (1954) stated 
that her first-grade class had made a fine record on their achievement 
test. The Study of the Whitman School Faculty suggested that Mrs. 
Duval was not well integrated into the social system of Whitman. Mrs. 
Nasca was closer to Mrs. Duval than other teachers. Mrs. Nasca had 


8’ Norman Frederiksen, Factors in In-Basket Performance, Office of Naval Re- 
search Technical Report (Princeton, New Jersey: Educational Testing Service, 
1961). 
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taught music to Mrs. Duval’s class and worked with both of their classes 
on a series of assemblies. Thus it was possible to piece together quite a 
lot of scattered information about Mrs. Duval as a teacher. 

The methods of presentation also added to the realism of the situa- 
tion. The items of the in-basket test were not all presented as pieces of 
paper collected together in one bundle. Some items were presented as 
a mail delivery after the principal had started work on his in-basket. 
Other items were provided by the use of tape-recorded interruptions by 
the principal’s secretary. In these cases the principal’s attention was 
attracted by a knock on his door (tape recorded) and an excited report 
of an emergency situation. 


INSTRUCTIONS FOR TAKING THE IN-BASKET TEST 


The instructions for an in-basket test are especially important, be- 
cause it is necessary to create an attitude in the examinee which is differ- 
ent from the usual test-taking attitude. The usual test requires that the 
examinee devise or select “right” answers to a large number of problems, 
each of which is clearly identified as a problem. In the case of an in- 
basket test, on the other hand, the objective is to elicit behavior of the 
sort a person might typically display on the job. There is interest not 
only in the substantive aspect of what is done, but also in the style with 
which it is done. Therefore, the attempt was made in the instructions to 
get the examinee to behave spontaneously as though he were on the job. 
He was not to indicate abstractly what should be done or what he would 
do. He was instead actually to do something—write letters or memo- 
randa, prepare agenda, make notes or reminders for himself, just as he 
would at his own desk. 

It was necessary to provide a situational setting for each in-basket 
test, which gave a plausible rationale for the accumulation of a heavy 
load of work in the principal’s in-basket. An attempt was made to struc- 
ture each situation in such a way as to require the principal to attend to 
the problems personally and to make it difficult for him to postpone the 
work or assign it all to others. 

The first in-basket was set for Labor Day, just prior to the opening 
of school; it contained 33 items. The printed instructions to the princi- 
pals were as follows: 


INTRODUCTION TO LABOR DAY IN-BASKET 


Along with these instructions we have given each of you two large 
envelopes. One, marked Packet A, contains special test materials which will 
be described to you in more detail later, and the other, Packet B, contains an 
assortment of papers, forms, pencils, paper clips, etc., which you are to use 
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in your work this morning. These materials represent the first of four “in- 
basket” tests that you will be working with today and tomorrow. 

The materials in Packet A were left in your “in-basket” for you by your 
secretary, Ruth Platz. As you will recall, you accepted the position of 
principal of Whitman School in May, but you had already agreed to spend 
the summer as a Camp Director some distance away. You were able to 
get into Jefferson on the afternoon of August 27. The next day was occupied 
with moving into a temporary home and generally getting settled. You 
managed to visit your office for a few minutes on Friday, August 29, at which 
time you met your secretary and asked her to get together any material you 
should see and put it on your desk. The material in Packet A is what she has 
left for you. 

Today is Labor Day, September 1. You have just arrived in your office 
and have only three hours before you will have to leave for an appointment 
with a real estate agent. You do not plan to return to your office. You are 
aware that tomorrow is likely to be a difficult day and that you will not have 
time to do any substantial amount of work. You hope that the three hours 
you have this morning will give you a chance to take care of the more 
pressing problems and also a chance to plan for some of the problems that 
you would need to be concerned with in the near future. 

No one is in your office except yourself. Your secretary volunteered to 
change her plans for a Labor Day week-end trip and to come into the office, 
but you declined her offer. You must, therefore, do what you can with 
the material in Packet A without help. 

Your task is to read this material and take appropriate actions. You 
should behave as if you are actually on the job. Use the materials in Packet 
B to write down everything you decide to do or plan to do. Write memos 
to yourself about things you want to do later. Draft letters, if appropriate, 
for your secretary to prepare. (Record in the form of notes what you say 
on the phone.) Outline plans or agenda of meetings you want to call. Sign 
papers, if appropriate. 

Everything you decide or do must be in writing. You should always 
take as much action as you can with the information available to you, but 
you must also avoid making any assumptions that are not reasonably sup- 
ported by the background information you have been given or by the “in- 
basket” material itself. 

When you prepare a letter, memo, or the like, unless it is obvious from 
its contents, try to identify it in such a way that we will know to what 
material you are referring, or simply clip it to the material involved. We 
know that many of these things normally would be handled more informally, 
but we must be able to know what you do. 

Be yourself, Marion Smith. Behave as though you were really on the 
job. Do not merely write descriptions of what you would write; write in- 
stead, the actual letters and memos! 

In your work this morning you may make use of any or all of the back- 
ground material which we have given you over the last two days. You will 
have two hours and fifteen minutes to work on this “in-basket.’”’ At the end 
of that time, we will interrupt you and give you another small task, which 
will be explained at the time. 


58 ADMINISTRATIVE PERFORMANCE AND PERSONALITY 


The following directions were given orally before the principals be- 
gan work on in-basket A: 


Before you start I want to emphasize one thing: You are Marion Smith 
and you are to behave as though you were really on the job; but everything 
you do or plan to do must be in writing. 

Let me mention the specific problem of phone calls. If you want to 
make a telephone call, indicate what you say or what you plan to say on the 
phone. You cannot, of course, know what the other person says in reply. 
Therefore, you should not report what the other person says. Nor, of 
course, can you at other times treat as fact assumptions you make about 
what others will do. 

Are there any questions about the situation or what you are to do? 


The period covered by in-basket C, which contained 32 items, pre- 
sumably occurred later in the year, after school had been under way 
for several weeks. The situation was described to the principals as 
follows: 


INTRODUCTION TO DECEMBER 4TH IN-BASKET 


Your task this afternoon will parallel your activity of the morning. A 
large envelope marked Packet C has been given to each of you. The contents 
represent your second “in-basket” test. In terms of time, three months have 
elapsed and you are now more settled in your position as principal of Whit- 
man School. 

Today is Thursday, December 4, 1958. It is your first day in the office 
since Friday, November 28. Sunday you left Jefferson to attend the La- 
fayette State Elementary Principals’ Association Convention in Luxor, 
Lafayette. You returned last night. This morning was devoted to a meeting 
with the Superintendent and a conference with one of your teachers. You 
have about three hours this afternoon to take care of the work that has 
accumulated in your absence. You have an engagement this evening. There 
will be no opportunity to return to your office again today. You must take 
care of any pressing problems and plan future actions in the time you have 
now. 

Ruth Platz has left a note for you bringing you up to date, but she will 
not be in the office at all. She left early yesterday suffering from a cold. 
Once again you are alone in your office and must do what you wish with 
the materials in Packet C without any assistance. 

Your task is to read this material and .. . 


The setting for the materials in in-basket D was the spring. There 
were 31 items and the test was introduced to the principals as follows: 


INTRODUCTION TO FEBRUARY 1OTH IN-BASKET 


Your work this morning will be quite similar to your work yesterday. 
However, there will be one major change. During the morning, while you 
are at work in your office, you will be interrupted once by the morning mail 
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delivery and twice by your secretary. We will simulate the latter type of 
interruption with tape recordings. These interruptions, which will be part 
of your morning’s task, will pose additional problems for you as principal. 
An envelope marked Packet D has been given to each of you. Both the 
contents of this envelope and the problems posed by the interruptions are 
part of this “in-basket” test. 

In terms of time, you have been in your position at Whitman School for 
about five months. Today is Tuesday, February 10, 1959. For the past few 
days you have been able to spend very little time in your office. In fact, 
since last Thursday afternoon you have been in conferences or otherwise 
occupied and have not been able to get to your paperwork. Monday, 
February 9, 1959, for example, you spent the morning with an important 
visitor and divided the afternoon between a committee meeting and a 
conference with Mr. Davies. 

One other event complicates the situation. Two weeks ago, Miss Helen 
Tague began her first day as your new secretary. Ruth Platz is now working 
in Dr. Seward’s office. Miss Tague had only two days with Ruth before Ruth 
had to be in her new position; therefore, Miss Tague has not been able to 
get well oriented. Miss Tague is trying to do a good job, but has much yet 
to learn. You have not had as much opportunity as you would have liked 
to help her get started. 

This morning, February 10th, is free from appointments and offers you 
the first chance to get at the accumulated work. You must take care of press- 
ing problems and plan future action in the time you have now. Miss Tague 
has left the materials in Packet D on your desk. 

As before, your task is to read this material and .. . 


The ‘‘small task” which the principals were given at the end of each 
in-basket was to fill out the Reasons-for-Action Form, which is de- 
scribed in Chapter 6. This form provided space in which the principal 
could state very briefly what he did in response to each item and why. 
It was needed for scoring purposes in order to clarify the actions taken. 


DEVELOPMENT OF OTHER ADMINISTRATIVE TASKS 

Although it was possible to build into in-baskets a wide range of 
administrative problems, it seemed obvious that there were definite 
limitations with regard to the types of responses that could be elicited. 
These limitations presumably were to be found mainly in the areas of 
oral behavior and face-to-face interaction with people. Although re- 
sponses to in-basket items reveal much more than cognitive perform- 
ance, it was thought that an attempt should be made to include in the 
test week some materials that would help assess interpersonal behaviors. 
The devices which were developed deal with (1) the principal’s role as 
the instructional leader and supervisor, (2) his skill in actual face-to- 
face interaction, and (3) his ability to speak before the public and to 
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write for purposes of public consumption. The construction and use of 
special kinescopes, tape recordings, and other techniques to cover these 
aspects of the job of the principal are described in this section. 


THE KINESCOPES 


In order to obtain measures of some of the supervisory aspects of 
the principal’s job, Marion Smith was shown three kinescopes depicting 
classroom scenes showing three teachers in action. At the completion 
of each film he was instructed to prepare in outline form the comments 
he might make to the teacher in an interview with her and to complete a 
probationary report to be sent to the central office. 

The kinescopes were made through the facilities and cooperation of 
the State University College of Education, Brockport, New York. The 
college specializes in the training of elementary school teachers. It had 
participated in a year-long program of instructional TV for the New 
York State Education Department, with the result that experienced 
“critic teachers” with one and a half years of experience in closed-circuit 
TV were available. Three of these teachers voluntarily participated in 
portraying teachers of three different qualities. 

Two films were made of each teaching episode by cameras in dif- 
ferent locations; the project staff was then free to review, edit, splice, 
and entitle the films. It was planned that each film should be “rich” 
enough to justify fairly extreme judgments, and should include both long 
shots and a number of specific incidents. The content of each kinescope 
is described in Chapter 9. 


TAPED RECORDINGS 


A series of five events involving different educational problems were 
tape recorded. These provided an opportunity for the principals to 
demonstrate sensitivity to issues and problems of an educational con- 
tent as suggested by discussions of educational problems by profession- 
ally trained personnel. 

All the tape recordings were made at actual events at the prototype 
school, and were edited to remove statements which would permit identi- 
fication of people or community. One conference was between a parent 
and a teacher; another involved a discussion of a problem child by a 
teacher, the school psychologist, and other members of the school staff. 
A third tape contained a portion of a speech delivered by the superin- 
tendent of the prototype school; the other two tapes were recordings 
made at a special Board of Education meeting attended by all the prin- 
cipals of the prototype school. 


STRUCTURING WHITMAN SCHOOL 61 


For the test the principals in the study were supposedly present at 
each conference. At the end of each recording, the principal was asked 
to answer a set of four specific questions. The conferences and the ques- 
tions are described more fully in Chapter 9. 


INTERACTION PROBLEM 


The group interaction problem was developed in order to observe 
the performance of the principals in face-to-face situations. The prob- 
lem presented for solution is that Marion Smith has been promoted and 
it is necessary to recommend someone to fill his position. The principals 
were assigned to committees, and given information about the three can- 
didates. Each committee was asked to recommend one candidate to the 
Superintendent. A member of the research staff played the role of the 
Assistant Superintendent for Business Management and moderated the 
meeting; another member of the research staff was an observer. During 
the committee discussion, one staff member kept a record of the state- 
ments made by the five committee members, while the other filled out a 
form in which the statements of each member were recorded under 
headings which described the content of the statement. The interaction 
problem is described fully in Chapter 10. 

The subject of the conference—recommending a new principal for 
Whitman School—was chosen because it permitted the principals to 
make use of the information they had acquired about their school and 
community and because it was a problem they had seldom if ever faced 
in real life. 

Several preliminary runs of the interaction problem were conducted, 
some involving members of the research staff. These preliminary trials 
were useful in determining appropriate time allotments and especially in 
determining what categories should be used in the observer’s Group Re- 
port Form. The content categories were developed mainly through at- 
tempts to classify the comments made by participants in the preliminary 
tryouts. 


REACTIONS OF THE PRINCIPALS TO WHITMAN SCHOOL 


Many of the principals who were the subjects during the test week 
reported that the simulation of a working situation for an elementary 
school principal was very effective. Whitman School was real to the 
participants, in spite of the absence of the smell of chalk dust. One prin- 
cipal of many years’ experience reported that all except one of the in- 
basket problems had happened to him, the exception being a proposed 
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visit to the school by a United States Congressman. Vivid images of 
the people in Jefferson were built up, and many firm likes, dislikes, 
loyalties, and prejudices were developed in the principals. It is the 
opinion of the research staff members who administered many of the 
test weeks that one of the hopes of the study was largely realized: The 
participants behaved as principals of a school, not merely as examinees 
taking a test. 


Chapter 5 
THE PARTICIPANTS IN THE STUDY 


IN OBTAINING SUBJECTS FOR THIS STUDY, THE OBJECTIVE WAS TO MAKE 
the sample as varied as possible with respect to the many kinds of dif- 
ferences found in the contemporary population of elementary school 
principals. It was reasoned that if the sample of principals reflected 
the various differences in biographical and cultural factors found in the 
population of principals, then their behavior would reflect the different 
styles and approaches that characterize the population in the kind of 
school situation simulated by the experiment. Thus an attempt was made 
to enlist both men and women subjects, differing in such biographical 
factors as age, occupational experience, professional education, and 
cultural factors as are engendered by differences in regional hiring prac- 
tices and community customs. 

Since the object of the research was to describe and understand pat- 
terns of administrative behavior rather than to establish norms for such 
behavior, no effort was made to obtain a sample that would be repre- 
sentative of the population with regard to any variable. 

As can be seen from inspection of Table 1 the subjects came from 
many sections of the country, from communities of different sizes, from 
systems with vastly different salary and pupil-expenditure levels, and 
with very different reputations for excellence. 

For reasons of administrative convenience, relatively few principals 
from very small school systems were included.! As a result, only two of 

*It took between one and three trips and from 10 to 60 hours of staff time 


to arrange for a school system to participate, to administer preliminary tests, and 
to set up a testing center. More time was required to arrange the administrative 
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the principals in the study sample spent some time each day in classroom 
teaching. If there is reason to believe that teaching principals vary in 
some systematic way from the full-time principals of the present sample, 
the findings of the research may not be generalizable to teaching princi- 
pals. 

Selection took place at two levels—the school system and the indi- 
vidual principal. There was no practical way to include principals work- 
ing in systems that did not choose to participate. Since interest and rap- 
port were essential if the subjects were to do the work required for full 
participation in the research, only volunteer principals were used. Ap- 
parently this use of volunteers did not limit the variations found in the 
group, although the members may have been more self-confident and 
trusting than would have been the case with a group drawn at random 
from the same school systems. 

The final selection of participants within a school system was made 
by the superintendent, or the coordinator appointed by him, with con- 
sultation of a project staff member. The school-appointed coordinator 
was asked to appoint, from among the group of volunteers, not only the 
best or the most experienced principals, but a cross section of the group, 
including some who were regarded as experienced and competent, some 
as weak, some as young and promising, and so on. The reader may 
judge from the tables in this chapter the extent to which these selection 
criteria were actually used. 


BACKGROUND AND EXPERIENCE CHARACTERISTICS 
OF THE SAMPLE’ 


Of the 232 principals studied, 137 were men and 95 were women. 
Twenty-seven men and 10 women in the group were Negroes; all others 
were white, of European extraction. Thirty-eight were employed in the 
northeastern census area, 104 in the southern, 30 in the north-central, 
and 60 in the western. One hundred thirty-two were in the school sys- 
tems of large cities, 89 in small city and suburban systems, and 11 from 
county or rural systems. 


details with small systems than with large ones because smaller systems generally 
did not have experienced personnel to handle the problems that participation 
entailed. 

*Information summarized in this section was taken from the Professional 
Experience Record (completed by the school system) and the Personal History 
Blank for School Administrators (completed by the principal). Both forms were 
especially constructed for this study. 
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TABLE 2. Distribution of ages by sex of 232 elementary school principals 


Women Men 
NUMBER PER CENT NUMBER PER CENT 

30 or younger 0 0 3 Ded 
31-35 1 ii 2) 18.2 
36—40 3 3 22 16.1 
41-45 Tl 11.6 32 23.4 
46-50 22 2oe2 27 19.7 
51-55 31 32.6 12 8.8 
56-60 21 PAPA 13 9.5 
61 or older 6 6.3 0 0 
No information 0 0 3 pigs 
Mean 51.6 42.2 


Table 2 presents the distribution of the ages of the 232 principals 
for men and women separately, and shows that the women in the sample 
are on the average almost ten years older than the men. This difference 
is apparently in part a consequence of recent changes in hiring and pro- 
motion policies: More men than formerly are now hired as full-time 
principals. This accounts for the predominance of men under forty in 
the group. The predominance of women in the older age range is un- 
doubtedly due to earlier hiring practices that favored women. It may 
also be a result of the tendency to regard the position as terminal for 
women, but as a step toward a position of greater responsibility, such as 
the superintendency, for men.* Differences between the sexes are to be 
expected, not only because a portion of the more experienced men have 


TABLE 3. Marital status of men and women principals 


Women Men 
NUMBER PER CENT NUMBER PER CENT 
Single 49 51.6 6 4.4 
Married bye Sahil 128 93.4 
Widowed . 10 10.5 0 0 
Divorced or separated 4 4.2 73 1) 
No information 0 0 1 ati 


* National Education Association, Department of Elementary School Princi- 
pals, The Elementary School Principalship, A Research Study. Thirty-Seventh 
Yearbook (Washington, D.C.: National Education Association, 1958), pp. 
114-115. 
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TABLE 4. Social origins of 232 elementary school principals 


Women Men 
NUMBER PER CENT NUMBER PER CENT 
Father’s occupation: 
Professional 14 14:7 14 10.2 
Business 41 “key 7 55 40.1 
Farm 15 lieve: 21 1 fe, 
Labor 15 126 32 23.4 
No information and 
unclassified 10 10.5 13 10.9 
Father's education:* 
2-8 49 51.6 719 aie 
9-12 29 30.5 31 LEG 
13-16 10 10.5 17 12.4 
Above 16 3 332 5 3.6 
No information 4 4.2 5 3.6 


* Highest grade attained. 


moved into other positions, but because the attractions of the job are 
somewhat different for men than for women. 

Table 3 shows that there are appreciable differences in marital 
status for the two sexes. Whereas more than 90 per cent of the men are 
married, approximately half the women are single. Other differences in 
this table are probably a result of differences in age. 

Social background of the sample is indicated in a general way by 
Table 4. No direct way of making comparisons with comparable age 
groups is available, but it is apparent that more of the principals are the 
children of business and professional men while appreciably fewer of 
the group than of the population as a whole are from laboring and farm- 
ing families. 

The average number of years of schooling for fathers of this group 
appears to be about the same as for the current American population of 
twenty-five or older.t However, since number of years of education is 
highly correlated (negatively) with age, these fathers are undoubtedly 
somewhat more highly educated than the average of their age group. 

The differences between men and women principals are less striking 
in this table, but may nonetheless be of significance. In interpreting these 
tables it is necessary to keep in mind that the father’s age is negatively 
correlated with both occupational status and education. That is, the 


*U. S. Department of Commerce, Bureau of Statistics, Statistical Abstracts of 
the United States (Washington, D.C.: The Bureau, 1956), p. 111. 
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older the group of principals, the smaller the proportion of fathers who 
are professional, business, and clerical workers, and the larger the pro- 
portion of farmers and laborers. Similarly, the older the members of any 
group the less formal education is to be expected of their fathers. Since 
the men in this study are, on the average, almost a decade younger than 
the women we would expect that if men have been selected on the same 
basis as women, the average education of the fathers of men in the study 
would be somewhat higher, and thus more of the men principals would 
have come from professional or business homes. However, the differ- 
ences that occur are in the opposite direction. It appears that the social 


TABLE 5. Education and experience of elementary school principals 


Women Men 
NUMBER PER CENT NUMBER PER CENT 
Education: 
Some college 3 Bh 0 0 
Bachelor’s degree Pat ae ibe 8.8 
Work toward Master’s 4 4.2 12 8.8 
Master’s degree a1 ai Ey 97 70.8 
Work beyond Master’s 12 12.6 12 8.8 
Doctor of Education 
degree 0 0 3 Zee 
Doctor of Philosophy 
degree 2 Jap 0 0 
No information 2, Paes 1 4 
Administrative experience:* 
0-1 1 jit 9 6.6 
2-3 10 1035 i 12.4 
4-5 13 Lead, 22 PGs 
6-10 13 T3eh 3 28.5 
11-15 28 29%) 25 18.2 
16-20 9 Or 16 me Ley. 
21-25 at 11.6 5 3.6 
26-35 9 9.5 4 29 
No information 1 el 0 0 
Mean 1352 ee) 
Teaching experience: 
All elementary 30 31.6 33 24.1 
Elementary and secondary 2 Del 22 16.1 
All secondary DL TG 34 24.8 
Other 40 42.1 Jeg 19.7 
No information 12 12.6 21 (hee! 


* Years of service as a principal. 
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origins of the older women principals in this study are of somewhat 
higher status or that the men principals are now being drawn from lower 
socioeconomic groups. Since attitudes and goals associated with educa- 
tion are often different for different social classes, this possible change 
over time in the social origins should be kept in mind in interpreting 
some of the findings of this study, particularly those in the area of con- 
cerns and values. 

Table 5 shows that the principals in the sample differed widely in 
amount of formal training and in the amount and kind of experience on 
the job. More than 80 per cent of the men principals held at least a 
master’s degree as compared with 70 per cent of the women. Appreci- 
ably fewer women than men have done graduate work—a reflection, no 
doubt, of the increased formalization of requirements since some of the 
older women achieved tenure. However, a larger proportion of women 
than men have done work beyond the master’s degree. Two women and 
three men held doctorates. 

In light of their higher mean age, it is to be expected that women 
would have had longer professional experience than men. The lack of 
marked differences in length of administrative experiences (Table 5) 
probably indicates that women on the whole were promoted to a princi- 
palship only after longer experience as teachers or supervisors. 


TABLE 6. Comparison of research sample of 232 elementary school prin- 
cipals with recent NEA survey sample of 2000 principals* 


NEA SURVEY SAMPLE RESEARCH SAMPLE 
CATEGORY OF COMPARISON Women Men Women Men 
Nie] 608 Nii 40 N 395 Ney, 


Per cent of group 38.0 62.0 40.9 SOT 


Age (median) Jeb 43.7 50.9 42.5 
Education: 
No degree 4.0 none oe none 
B.S. only 23.0 12.0 26.3 Les 
Master’s 71.0 80.0 yeh! 70.8 
More than Master’s 2.0 8.0 14.7 10.9 
No information —— — 2at oy 


Experience (median): 
Total years in education 30.0 17:9 28.9 16.3 
Total years as principal 10.3 8.4 1287 FT 


* National Education Association, op. cit. 
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CONTEMPORARY POPULATION OF ELEMENTARY 
SCHOOL PRINCIPALS REPRESENTED IN THE SAMPLE 


Since the 232 subjects in this research were not selected randomly, 
there was no reason to expect that they would be representative of the 
population of elementary school principals in the 50 states. Nevertheless, 
it turns out that on the variables for which comparisons are available 
the research sample is remarkably representative. In Table 6, the sex 
distribution, age, education, and experience of the sample is compared 
with similar data obtained from a recent representative sampling of the 
elementary principal population.® 

While it would be unsafe on the basis of this comparison to general- 
ize that the research sample is in every way a representative sample of the 
population of elementary school principals, one can be reasonably sure 
that is not markedly deviant. The comparisons in Table 6 suggest that 
such findings as are presented in Chapter 11 (relating amount of formal 
training to reputation and performance as a practicing principal) are 
not likely to be explained on the basis of the peculiar characteristics of 
the research sample. 


PERSONAL CHARACTERISTICS OF THE PRINCIPALS 


In addition to the data presented in Tables 2 through 6, by means 
of which it was possible to describe the sample by relating it to the parent 
population, the sample can be described in another way. A rather ex- 
tensive battery of tests measuring professional knowledge, abilities, tem- 
perament, and interests was given to each principal. The performance 
of the principals on these tests provides additional information about 
them. 

It is the purpose of this section of the chapter to describe the meas- 
ures obtained from this battery and, where data are available, to indicate 
how the research subjects compare with other groups on these measures. 
Since the data presented in the preceding section indicate that women 
and men principals in the sample may be drawn from rather different 
subgroups of the population, the data of this section are tabulated by 
Sex. 

° National Education Association, op. cit., pp. 114-115. 

* Differences between the mean scores on each of 137 variables for men as 
compared with women were tested for significance; the results are tabulated in 


Appendix D. Only those differences reaching at least the .05 level of confidence 
will be discussed here. 
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BACKGROUND 

At the meeting with the group of principals prior to the experimental 
test week, a member of the research team gave each participant a packet 
of materials which included a biographical inventory, the Strong Voca- 
tional Interest Blank for Men, the Symonds’ Educational Interest In- 
ventory, and the Sixteen Personality Factor Questionnaire. (These ma- 
terials were to be completed at a later time and mailed to Educational 
Testing Service.) On the following morning, a battery of basic mental 
ability tests was administered. In the afternoon two objective examina- 
tions, School Administration and Supervision, and the National Teacher 
Examination optional test in Education in the Elementary School, were 
administered. Two NTE Common Examinations subtests, one of Science 
and Mathematics, and the other of Social Studies, Literature, and Fine 
Arts, were administered during the evening of the second day of the test 
week. 

Each of the tests employed is described briefly, and a comparison 
of the performance of the men and women principals is presented. 
Where suitable data are available, the performance of the principals is 
compared with that of other groups. 


PROFESSIONAL AND GENERAL KNOWLEDGE 

Four tests were used as measures of professional and general knowl- 
edge. The professional knowledge of the principals was measured by 
School Administration and Supervision, Form FPE,, a 90-minute,‘ 
110-item measure of knowledge of accepted administrative and super- 
visory principles and practices in education, and by Education in the 
Elementary School, Form K-ENT, an 80-minute, 120-item measure of 
knowledge of both substantive content and teaching methods. The Sci- 
ence and Mathematics (30 minutes, 55 items) and the Social Studies, 
Literature, and Fine Arts (30 minutes, 65 items) subtests of the NTE 
Common Examinations, Form GNT, were used as measures of general 
knowledge. Data from these tests are presented in Table 7. 

The means and standard deviations for the School Administration 
and Supervision test are given only in raw score units. For the other 
three tests, scaled score units are also reported. The scaled score mean 
and standard deviation are 60 and 10 for the normative sample, which 
includes all teachers or prospective teachers to whom the tests were 
given in nationwide administrations of the National Teacher Examina- 

* The standard time for this test is 80 minutes. On the advice of the Director 
of National Teacher Examinations, 90 minutes were allowed in this research in 


order to minimize the speed factor, which might particularly affect the older 
subjects. 


pe ee ee ee nee 


606,015 85m 1665 8 SsV6 js ONSET Ol cot 8S cre SUV oul pue 
‘QINJVIaWT ‘SoIpnyg [e190 
Ol S23 LOR LG Lk Secs Y LS I8bl OT $9°8 v9 STOC soemoarie pue sdUsI9§ 

Cees eC eee me LCL 6 EO G1 G9 L Leo Gee 91s eV eee cs Jooyps ArejusWsl 7 
ay} Ul UoT}eONpY 

eee OSiY,[ ae omer O.OV oe OUT] aeeermeenn | O-()S zeae CG eee eae EGY, wolstAredng pue 


UoNeIsIUIUIpY [OOS 
ee Eee seein ne ns ee ee oe Se ee 


alOIG alOIS alOIS asoIg al0IG alOIS IlOIS a40IS J10IG adOIS adOIS |adOIS 
pajvog “py papog mpy papas MDY pavoy MDy pavos MpYy pav9g MDY 


‘a's NvaW ‘a's NvaW ‘a's NVaW SOL 


[DIOL uawUo 4 uaW 


ee. 


aBpajMouy jpsiaue6 pup jouolssajoid jo sjsey uo sjodisuyid yo aoupuojied “2 F1aVL 


va 


72 ADMINISTRATIVE PERFORMANCE AND PERSONALITY 


tion during 1954-1958. Comparable normative data are not available 
for the School Administration and Supervision test; therefore scaled 
scores cannot be reported. 

It will be noted from Table 7 that the principals, particularly the 
women subjects, appear to have an appreciably better knowledge of the 
principles and practices of elementary education than do the group on 
whose performance the norms were based—a group made up largely of 
college seniors preparing to teach. The men principals earned somewhat 
higher scores on the Science and Mathematics test than the women. 
Both men and women did slightly less well on the Social Studies, Litera- 
ture, and Fine Arts test than did the norms group. 


VOCATIONAL INTERESTS 


The Strong Vocational Interest Blank for Men was completed by all 
subjects. This widely used test provides for each of more than 30 occu- 
pations ‘‘a measure of how nearly the person’s interests coincide with 
those of the average person successfully engaged in the occupation.”® 
The extent of this coincidence is indicated by letter ratings (A, B+, B, 
B—, C++, C) which are set so that an A rating means that the individual 
has the interests of the person successfully engaged in the occupation; 
a C rating means that the person does not have such interests. Approxi- 
mately 70 per cent of the people successfully engaged in an occupation 
receive an A rating for that occupation; an additional 13 per cent score 
in the B+ range, 9 per cent in the B range, and 5 per cent in the B— 
range. Only 3 per cent fall below this point. Ratings of C and C+ 
thus indicate little similarity to the criterion group with respect to in- 
terests. : 

The eighteen scores that were used in this study are shown in Table 
8, which also shows the means and standard deviations of the 18 scores 
by sex and the per cent of principals who obtained A scores for each 
vocation. 

As might be expected, the principals most nearly resemble those 
occupational groups whose work involves working with people, usually 
in a social service setting. The interests of the group, as a whole, seem 
to be least like those of engineers and purchasing agents. 


BASIC MENTAL ABILITIES 
Research in psychology has, in the past two decades, identified a 
number of cognitive ability factors in terms of which individual differ- 


*Edward K. Strong, Jr., Manual for Strong Vocational Interest Blank for 
Men (Stanford, Calif.: Stanford University Press, 1951), p. 10. 
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ences can be described. Some of these, including the verbal and reason- 
ing factors, are widely known and have been shown to be related to per- 
formance in a wide variety of situations. Measures for 13 of these ability 
factors were included in this study. Except for the test of verbal knowl- 
edge, all tests in this battery were given under speeded conditions. 

The specific abilities for which measures were obtained are described 
below.?® 


1. Deduction (D-—2)!° is the ability to reason from given facts to 
their necessary conclusions. The test used was entitled Reasoning. This 
factor seems to be involved in the process of understanding specific 
materials (e.g., reading) “by relating it (the problem) to general prin- 
ciples about things and situations which have been accumulated as a 
result of past experience.’’"? 


ITEM TYPE: Read the Given Facts below and fill in the blanks in Conclusion. 
GIVEN FACTS CONCLUSION 


a Fee alee a therefore K is otdeny than M. 


The test contains 30 such items to be completed in six minutes. 


2. Induction (I—1) is the ability to discover a general concept that 
will fit a set of data. The test used was entitled Letter Grouping. 


ITEM TYPE: In each row three of the groups of letters are alike in some way. 
Mark the one that is different. 


AABA ACAD ACFH AACC 


[| a] [| 


The test contains 30 rows of letter groups to be done in three minutes. 


3. General reasoning (R—1) is the ability to carry out the kind of 
reasoning required in the solution of mathematics problems. The test 


* Nine of these factors are described in a monograph by John French, “The 
Description of Aptitude and Achievement Factors in Terms of Related Factors,” 
Psychometric Monograph No. 5 (Chicago: University of Chicago Press, 1951). 
The tests for these nine factors are taken from the Kit of Selected Tests for 
Reference Aptitude and Achievement Factors, assembled by French in 1954. The 
four fluency factors are described in J. P. Guilford, “Creative Abilities in the 
Arts,” Psychol. Rev., 1957, 64, 110-118. The fluency tests were obtained from 
the Sheridan Supply Company, Beverly Hills, California. 

* The notation in parentheses following the factor name is the Kit code 
number for the test used. 

* French, op. cit., p. 206. 
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used was entitled Mathematics Aptitude Test. This test measures the 
well-known quantitative factor in academic aptitude tests. 


ITEM TYPE: How many pencils can you buy for 50 cents at the rate of 2 
for 5 cents? 


(a) 10 (6)) 20 (c)e2 (d) 100 (Ce) e125 


The test consists of 20 items with a time limit of 10 minutes. 


4. Verbal knowledge (V—4) is general knowledge and understand- 
ing of language. The test used was entitled Advanced Vocabulary. 


ITEM TYPE: Select the closest synonym and circle the number in front of it. 


jovial 1. refreshing 
2. scarce 
3. thickest 


. wise 
jolly 


The test contains 36 items, covering a wide range of vocabulary, on 
which the principal had seven minutes to work. 


5. Flexibility of closure (Cf—1) is the ability to keep in mind a def- 
inite configuration and to identify it in spite of perceptual distractions. 
The test used was entitled Concealed Figures. 

ITEM TYPE: A figure is presented along with four more complex drawings. 


Each complex drawing in which the figure, unchanged as to size or orienta- 
tion, can be identified is to be checked. 


1 ps 


Tear 


The test contains 49 sets of figures and drawings and was given with a 
time limit of 10 minutes. 


6. Speed of closure (Cs—1; Cs—3) is the ability to unify an appar- 
ently disparate perceptual field into a single percept. (In tests of this 
factor, the subject does not know what it is he is looking for, while in 
the flexibility of closure test he does.) Two tests were used; one was en- 
titled Four-Letter Words (Speed of Closure 1), and the other Gestalt 
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Completion Test (Speed of Closure 2). The Four-Letter Words test 
was administered as the second in the battery. 


ITEM TYPE: Draw a circle around each four-letter word in the rows below. 


P ROHAMG EQ@INDEYEK ZCI@O CRW QEHOYRSALCINE) 


The test contains 1012 letters arranged in 22 rows of 46 letters each. 
The time limit was two and one-half minutes. 

The second test of speed of closure, the Gestalt Completion Test, 
was the final test in the battery. ; 


ITEM TYPE: Identify the pictures. Return later to those you find difficult. 
Write your answer on the lines. 


The test contains 24 pictures and had a time limit of two minutes. 


7. Associational fluency is the rate at which words of similar mean- 
ing, or fitting a common set of rather narrowly defined specifications, 
can be called forth. The test was Associational Fluency 1 (Form A).}? 


ITEM TYPE: Write words similar in meaning to the word SOFT. 


soft pera ee 
—jploitec 
ESB Fo 


The test consists of four simple words, each word being followed by 20 
spaces in which to write similar words.. The time limit was four minutes. 


8. Expressional fluency is the ability to produce continuous dis- 
course under conditions which restrict the permissible topics or usages. 
Tests of this factor seem primarily to involve the ability to put ideas 


Developed by Paul R. Christensen and J. P. Guilford, and published by 
the Sheridan Supply Company, Beverly Hills, California. 
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into words rather than the discovery of ideas. The test used was en- 
titled Expressional Fluency (Form A).}% 


ITEM TYPE: In this test you are to write sentences each made up of four 
words. Each word must begin with the letter indicated. 


Ports  undetank your  jdeaw 
Pare _ eva yee j mangas 


The test consists of four parts, each with spaces for the construction of 
up to 16 sentences. The time limit was eight minutes. 


9. Ideational fluency measures the rate at which a succession of 
ideas meeting certain meaningful requirements can be produced. Quality 
of ideas is not important. The test used was Ideational Fluency 1 
(Form A ).14 


ITEM TYPE: Name SOLIDS that will BURN. 
Lupo 


The test consists of four parts, each with space for 28 names. The time 
allowed was 12 minutes. 


10. Word fluency is the rate at which words meeting definite struc- 
tural requirements can be produced. The test employed was entitled 
Word Fluency (Form A).15 


ITEM TYPE: Write words containing the letter J. 


rr fo 


The test consists of two parts, each defined with a different letter fol- 
lowed by spaces for up to 48 words. The time available was four min- 
utes. 

¥ Ibid. 


*« Ibid. 
* Ibid. 
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11. Associative memory (Ma—1; Ma-3) is the ability to remember 
arbitrarily established relationships between items or objects. Two tests 
were used, First Names (Associative Memory 1) and Picture Numbers 
(Associative Memory 2). 

In the First Names test a list of 20 first and last names (e.g., Sammy 
Banks) is presented to be learned. The subject then turns the page and 
is required to supply the first name for a reordered list of the last names. 
In the Picture Number test the same format is followed, but numbers 
given to 21 simple objects must be recalled. The time limit for the first 
test was eight minutes, five to learn the names and three to recall them. 
The time for the second test was six minutes, divided into three minutes 
for study and three for recalling the items. 


12. Number facility (N—3, N—1) is the facility with which numbers, 
or perhaps other well-practiced symbols, can be handled when the sub- 
ject is thoroughly familiar with the rules governing their use. Two tests 
were used for this factor, the Addition Test (Number Facility 1), and 
the Subtraction and Multiplication Test (Number Facility 2). 


ITEM TYPE: 
ADDITION TEST SUBTRACTION AND MULTIPLICATION TEST 
4 7 12 60 40 56 47 
2 6 5 -—32 —19 x4 x8 
1 15 67 am [sure] 
[esa] ke, Dea 


The Addition Test contains 90 three-figure examples with a time 
limit of three minutes. The Subtraction and Multiplication Test con- 
tains five rows (10 examples each) of subtraction items alternated with 
five rows of multiplication. The time limit was three minutes. 


13. Visualization (V2—1) is the ability to manipulate mentally 
visual images, to comprehend rearrangement of figures in two-dimen- 
sional space. The Paper Form Board was used. 


ITEM TYPE: Draw pencil lines in the white outline to show how the black 
pieces can be placed to fit the outline. 


The test contains 42 problems to be done in seven minutes. 
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The means and standard deviations for men and women principals 
on each of these tests are given in Table 9. 

Meaningful normative data for these tests obtained from comparable 
groups under similar conditions are not available. It is possible, how- 
ever, to note differences between the men and women principals who 
participated in the study. Women principals tended to earn higher scores 
than men on the tests of number facility and verbal knowledge. Men, on 
the other hand, did somewhat better on tests of reasoning, flexibility of 
closure, and visualization. These differences may be attributed in part 
to the fact that the men tended to be younger than the women principals. 
The differences appear to be important in interpreting several of the 
findings of the study where differences between men and women are 
noted in their performance of administrative tasks. In later chapters of 
this report, as will be seen, the patterns of relationship between many 
of the tests and other variables can be understood by references to pre- 
vious research in which tests measuring the same basic factors were em- 
ployed. 


MEASURES OF BASIC PERSONALITY FACTORS 


Forms A and B of the Sixteen Personality Factor Questionnaire'® 
were given. Fifteen of the 16 scores were obtained. Factor B, a short 
measure of “general intelligence,’ was not used in this study, since this 
is presumably what is measured by the common variance in the pure 
factor tests. The 15 scores are described below. 

Factor A: Friendly vs. Aloof.1” The friendly end of this measure 
seems best characterized by an interest in people and a good-natured, ac- 
cepting attitude, in contrast to the aloof end which is characterized by an 
uneasy concern about interpersonal behavior and a cool, critical, some- 
what rigid attitude.1® 

Factor C: Emotional Stability vs. Lack of Frustration Tolerance. The 
behavior of the emotionally stable person is characterized by a high 
degree of integration and frustration tolerance; such a person has the ca- 


** Raymond B. Cattell, David R. Saunders, and Glen F. Stice, Handbook for 
the Sixteen Personality Factor Questionnaire. Champaign, Ill.: Institute for 
Personality and Ability Testing, 1957. 

“In this section the letters correspond to those used by the test authors. The 
verbal titles, however, have been adapted with special regard to the purposes of 
this report. 

** This and the following descriptions are meant to indicate the extremes of a 
particular spectrum of social behavior. The conceptualized dimensions underlying 
these traits are continuous, and most people are best described in terms of the 
degree, or relative predominance, of one or the other aspects of the continuum in 
their behavior. 
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pacity to postpone gratification without experiencing annoyance or ir- 
ritability. In contrast, the person low on this dimension, lacking frustra- 
tion tolerance, is prone to feel and show irritation and to respond to 
momentary impulses without sufficient regard for long-term objectives 
or for incidental, but not necessarily trivial, consequences. A lack of 
emotional stability may not always be apparent in actual behavior, since 
an individual may, through Character Strength (Factor G) or Character 
Stability (Factor Q3) consciously repress or redirect nonintegrative im- 
pulses. The combination of a low score on emotional stability and a high 
score on character strength may be predisposing to various manifesta- 
tions of anxiety and neuroticism (measured by factors O and Q,). The 
emotionally stable person is typically rated by peers as “mature,” 
“calm,” and “realistic,” while the person on the other end of the con- 
tinuum is more often rated as “changeable,” “evasive,” “worrying.” 

Factor E: Dominance ys. Submission. Persons scoring high on this 
factor are perceived as assertive and self-assured, independent, stern, 
and to some extent unconventional and attention-getting. Persons scor- 
ing at the opposite pole are dependent, kindly, expressive, and conven- 
tional. 

Factor F: Enthusiastic ys. Sober. The enthusiastic or “surgent” 
person is perceived as talkative, cheerful, placid, frank, impulsively kind, 
expressive, alert, and fond of large gatherings, in contrast to the sober 
or desurgent person who is regarded as quiet, introspective, languid, 
and conscientious. The enthusiastic is quick to see the ‘“ccommon-sense”’ 
answer; the sober more inclined to see the subtle and tenuous implica- 
tions. 

Factor G: Character Strength vs. Lack of Conventional Standards. 
The person scoring high on this factor is rated as persevering, responsi- 
ble, and conscientious. Factor G probably represents the variance in the 
extent to which people regulate or find satisfaction in regulating their 
expression of interest and emotion to accord with their implicit under- 
standing of what is moral, or what is approved by the community. 

Factor H: Adventurous vs. Shy. The adventurous person, as opposed 
to the shy, is more impulsive and less concerned in responding to his 
general environment. He is perceived as gregarious, bold, and frivolous, 
and as showing strong sentimental interests. 

Factor I: Emotionally Sensitive ys. Tough Practicality. This factor 
seems to approximate the tender- and tough-minded categorization de- 
scribed by William James. The emotionally sensitive person is per- 
ceived as demanding and dependent, imaginative, kindly, gentle, and 
aesthetically fastidious. In contrast, the tough, practical person is more 
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often seen to behave in an emotionally mature, independent, smug, cyni- 
cal, and responsible (as contrasted with frivolous) manner. 

Factor L: Suspicious ys. Trusting. Individuals scoring high on this 
factor tend to be seen as prone to jealousy, to be bashful, suspicious, 
dour, and hard. Those scoring low are more likely to be described as 
free of jealous tendencies, composed, trustful, adaptable, and concerned 
about other people. 

Factor M: Disregard for Conventions ys. Practical Concernedness. 
The individual scoring high on this factor unconcernedly goes his own 
way in his community, is emotionally egocentric, and does not feel much 
responsibility in practical matters. At the opposite pole, the individual 
scoring low is concerned about the practical and is anxious to do the 
proper thing. The high-scoring person is typically rated as unconven- 
tional, sensitive, imaginative, placid, undependable; he shows occasional 
hysterical emotionality. In contrast, the low-scoring person is more 
likely to be seen as conventional, logical, conscientious, and concerned 
about conventional values. 

Factor N: Sophistication ys. Rough Simplicity. This factor seems 
to reflect the extent to which a person characteristically takes a sophisti- 
cated, intellectual, and unsentimental approach to things. People scoring 
high are described as polished, cool, aloof, and fastidious, while those 
scoring low are better described as clumsy, easily pleased, and attentive 
to people. 

Factor O: Anxious Insecurity vs. Placid Self-confidence. The be- 
havior continuum described by this factor is best indicated by the dichot- 
omies anxious vs. placid and worrying vs. tough, calm. The underlying 
individual difference is probably one of concern with one’s ability to cope 
with the environment. People scoring high often report that they do not 
feel accepted and free to participate in social groups, and they are often 
perceived as ineffective speakers. 

Factor Q;: Radicalism ys. Conservatism. This seems to be a meas- 
ure of the extent to which one customarily reserves the right to question 
and to reach his own conclusions, on the one hand, and, on the other, 
accepts institutions and values as he perceives them to be interpreted 
by society. : 

Factor Q.: Independent Self-sufficiency vs. Lack of Resolution. The 
self-sufficient individual is accustomed to going his own way, apparently 
feeling little need for support by others. High-level business executives, 
natural scientists, and convicted criminals seem to score very high on 
this factor. At the opposite pole, the individual seems to receive a posi- 
tive satisfaction from participation in a social environment. 
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Factor Q;: Will Control and Character Stability. Individuals scor- 
ing high on this trait seem to orient their behavior in terms of their 
general system of values. Since their values may not be shared by asso- 
ciates, or since they may be in conflict with short-term group goals, high- 
scoring individuals are often seen as stubborn and obstinate, though at 
the same time considerate and conscientious. The behavior associated 
with low scores on the previous factor and on this factor are in many 
ways similar. In the former case, however, the behavior results from a 
desire to maintain a satisfactory interpersonal environment, and in the 
latter a lack of concern with the effect of behavior on more long-term 
objectives. At the opposite pole, the behavior associated with people 
scoring high on Will Control often resembles that found for persons who 
score high on Character Strength (Factor G); however, high Character 
Strength seems to involve the intuitive use of social norms learned in 
childhood, while high Will Control probably reflects the use of the indi- 
vidual’s own more or less rationally and consciously reasoned criteria 
and objectives. 

Factor Q,: Nervous Tension. The person scoring high on this factor 
is apparently tense, restless, and fretful. The factor is probably a meas- 
ure of anxiety arising from imperfectly suppressed drives; there is some 
indication of a correlation with sexual deprivation. 

The mean and standard deviations of the scores of the men and 
women principals on each of these 15 basic personality factors are given 
in Table 10, with comparable statistics for a group consisting of 156 
college students. 

From the results shown in Table 10, the principals in this study 
appear to be differentiated from the comparison group primarily in 
terms of factors F, H, L, O, Q3, and Q,. In contrast with the comparison 
group, which may be considered to be approximately a sample of the 
American college undergraduate population, the principals as a group 
appear to be: 

1. More inclined to be concerned with the subtle and long-term, 
and less quick to off-hand acceptance of the matter-of-fact and common- 
sense solution. They may also be expected to be more conscientious 
and less fond of excitement for its own sake. (Factor F: Enthusiastic 
vs. Sober) 

2. Less likely to take a “‘life is serious” attitude, or to find human 
contacts exhausting and adopt a shy, aloof, or withdrawing attitude. 
(Factor H: Adventurous vs. Shy) 

3. More trusting and adaptable, less critical, less skeptical, and in 
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general somewhat less tense and more relaxed in their approach to the 
social environment. (Factor L: Suspicious vs. Trusting) 

4. Somewhat more secure or confident in their handling of environ- 
mental problems. (Factor O: Anxious Insecurity vs. Placid Self-confi- 
dence ) 

5. More persistent and concerned with acting in accordance with a 
system of values. (Factor Q3: Will Control and Character Stability ) 

6. Less tense, more calm and self-assured. (Factor Qy: Nervous 
Tension) 

In general, these are the differences known from other studies!® to be 
characteristic of occupational groups in which normal professional ac- 
tivity calls for a great deal of social interaction and direction or super- 
vision of work by others. The general picture apparently is of a group 
that, in comparison with other groups of similar status and education, 
is somewhat more extroverted; more willing to make decisions and com- 
mitments, and less anxious about them (O and Q,); more purposeful 
(Q3); more levelheaded (F); and less concerned with possible hidden 
motives (L). 

Turning to sex differences within the sample of principals, women 
appear to be somewhat more emotionally sensitive (1) and more willing 
to disregard conventions (M) than men. They are less dominant (E), 
less suspicious (L), less sophisticated or shrewd (N), and less adventur- 
ous (H). Except that college-educated women tend to be more ad- 
venturous, these are the characteristic sex differences usually found with 
the Sixteen Personality Factor Questionnaire.*° The differences do sug- 
gest, however, a somewhat atypical orientation among men principals. 
In comparison with women principals the men tend to be more realistic 
and practical, but less conscious of human values; they may character- 
istically be more assertive, more ambitious, less gullible, and less tolerant 
of human weakness. 


* Cattell et al., op. cit. 
* Ibid. 


Norte, TABLE 10. The comparison group is the one reported in Raymond B. 
Cattell, David R. Saunders, and Glen F. Stice, Handbook for the Sixteen Person- 
ality Factor Questionnaire. Champaign, IIl.: Institute for Personality and Ability 
Testing, 1957 (Tabular Supplement, pp. 12-13). It consists of 156 American 
college students (men and women) of average age 21 and ranging from 17 to 30. 
Although somewhat younger, these college students probably more closely re- 
semble the principals of this study than would a random sample of persons in the 
adult population. 


Chapter 6 
SCORING THE IN-BASKETS 


AT THE CONCLUSION OF THE TEST WEEK, EACH PARTICIPANT HAD 
prepared a large number of handwritten documents, such as letters, 
memoranda, agenda, calendars, and reminders to himself as a result of 
his work on the in-baskets. This material constituted the record of his 
performance in response to a standard set of administrative items. The 
next task for the research staff was to reduce all this material to a set of 
measures based on a conceptual scheme which would adequately repre- 
sent the important aspects of the principals’ administrative performance. 
This required the development and application of scoring procedures. 
Aside from merely asking judges to make global judgments, there 
are two contrasting ways by which a record of performance can be as- 
sessed. One has to do with the content of the performance, or what is 
done, and the other with the style of the performance, or how it is done. 
Content refers to substance, the courses of action taken; for example, 
the principal called a meeting, refused a teacher’s request, followed the 
course of action recommended by a teacher, planned to discuss a prob- 
lem with a parent, or notified the superintendent’s office of the illness 
of a teacher. Style refers to attributes; thus a particular course of action 
(such as following a recommendation made by a teacher) could be done 
courteously or with formality; it could be done in writing, by telephone, 
or in face-to-face conversation; it could be done in a few words or in 
many. Content and style are not independent ways of looking at ‘per- 
formance since it is unlikely that the act of praising a teacher would be 
done discourteously. Nevertheless, content and style constitute ap- 
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proaches sufficiently different to justify using both in developing a 
method for scoring the work of the principals. 


SCORING FOR STYLISTIC CATEGORIES 


Because stylistic scoring has to do with how rather than with what 
was done it represents a different type of abstraction than does content 
scoring. 

The first question to be faced in developing the scoring system was 
“What are the stylistic attributes of performance which should be in- 
cluded in the system?” Two approaches were followed in obtaining these 
categories—one theoretical and one empirical. 

The theoretical approach involved the development of scoring cate- 
gories, each referring to a different attribute of style, which were sug- 
gested by current theories about leadership and administrative behavior. 
For example, Hemphill has proposed a theory of leadership and group 
problem solving which involves the concepts of initiation of structure 
and consideration.1 These concepts resulted in such scoring categories 
as Follows a Pre-established Structure, Initiates a New Structure, Cour- 
tesy to Subordinates, and Informality to Subordinates. Griffiths’ theoreti- 
cal work on administration involves the key concept of decision making.? 
His work resulted in such scoring categories as Sets a Deadline, Follow- 
up or Feedback Planned, Contingent Decision, and Arrives at a Pro- 
cedure for Deciding. 

The empirical approach involved, first of all, asking various judges 
to examine sets of in-basket responses and to write down brief descrip- 
tions of ways in which they saw variation in how the problems were 
handled. This procedure resulted in the collection of several hundred 
cards, each card containing a statement of some kind of difference ob- 
served in how principals worked on the in-basket problems. The cards 
contained phrases such as “overly critical of the work of others,” “‘com- 
pulsive,” “seeks temporary solutions,’ “‘postpones decision,” “neat,” 
“credulous—accepts statement without checking,” “makes unwarranted 
assumptions,” “authoritarian attitude,” and “suspicious of the motives 
of others.” 

The cards were then examined in an attempt to find a smaller number 
of concepts which would include as many of the statements as possible. 


39 66 


99 «66 


John K. Hemphill, “Administration as Problem Solving,” in Administrative 
Theory in Education, edited by A. W. Halpin (Chicago, Ill.: Midwest Administra- 
tion Center, 1958), pp. 89-118. 

* Daniel E. Griffiths, Administrative Theory (New York: Appleton-Century- 
Crofts, 1959). 
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The cards were sorted into categories each of which contained statements 
thought to be more or less synonymous with regard to some stylistic 
attribute of performance. The categories were further refined by using 
them in scoring a preliminary sample of in-basket responses. Categories 
which rarely occurred were eliminated or combined with others. Defi- 
nitions of the categories were rewritten to make them as unambiguous 
as possible while preserving distinctions which seemed important to the 
investigators. After a good many hours of tryout and discussion of 
categories suggested by both the theoretical and empirical approaches, a 
list of 68 categories was finally selected for use in the study. The nature 
of these categories will be described in a later section. 

A Score Sheet was designed which contains cells formed by rows 
representing in-basket items, and columns representing scoring catego- 
ries. The scorer, after studying the examinee’s response to an item, 
scanned the scoring category headings and generally recorded a 1 or 0 
in each cell of the row to indicate whether or not the behavior described 
by the scoring category occurred in the response to that item. The sec- 
ond item was scored by moving across the next row, and so on. The 
score for a particular scoring category was the number of 1’s recorded 
in the corresponding column. Since there were 132 items in all four 
in-baskets, the maximum possible score for most categories was 132. 
In certain categories, such as Number of Subordinates Involved Indi- 
vidually, the entry in each cell is a frequency which may be greater than 
1; in such categories the maximum possible score is, of course greater 
than 132. 


SCORING FOR CONTENT CATEGORIES 


The content of a principal’s response to an in-basket item may be 
thought of in terms of the courses of action he takes in handling the 
problem. For each in-basket problem, the major courses of action ac- 
tually taken by principals in the test situation were identified. What a 
course of action is can best be illustrated with an actual item. 

The topmost item on the first in-basket encountered by each princi- 
pal is shown in Figure 3. It is a telegram from a teacher, Miss Blake, 
stating that she is ill and will be unable to report for work when school 
opens. Here are ten courses of action, one or more of which were taken 
by some principals in response to this item: 


A. Communicate with superintendent’s office. 
B. Personally initiate procedure for obtaining substitute (without involv- 
ing superintendent’s office). 
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FIGURE 3. Item from first in-basket 


Use (or consider using) Miss Ash as substitute. 

. Provide for instructions and/or help for substitute. 

Have substitute attend faculty meeting. 

Convey condolence to Miss Blake. 

Send Miss Blake (or have sent to her) card and/or flowers, and/or 
gift, etc. 

Call Miss Blake’s attention to regulations regarding absence. 

Have records show Miss Blake absent from Tuesday faculty meeting. 
Refer to secretary. 


Se OmmDO 


The number of courses of action obtained for any one item was 
arbitrarily limited to ten. Most items required between five and ten 
courses of action to include the actions taken. The total number of 
courses of action identified averaged 210 for each of the Whitman School 
in-baskets and was 304 for the Bureau of Business in-basket. 

The procedures for identifying courses of action for the school in- 
baskets began by assembling committees of elementary school principals, 
who, working with research staff members, formulated all the courses of 
action which they could reasonably expect principals to carry out for 
each item. The lists so obtained were then revised after a preliminary 
attempt to apply them to responses actually made in a sample of in- 
basket responses. Courses of action were added, deleted, combined, or 
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otherwise edited until they seemed reasonably adequate for describing 
the content of the behavior of the principals. 

For the Bureau of Business in-basket, the lists were made up with- 
out benefit of committees, solely on the basis of analysis by staff members 
of the content of responses. The lists also were tried out and revised 
until they seemed to provide a satisfactory basis for classifying responses. 

Ten columns of the score sheet (labeled A to J) were reserved for 
recording courses of action. The scorer entered a 1 or 0 in each cell, the 
1 indicating that the course of action designated by the column heading 
(e.g., send flowers) was carried out in response to the item correspond- 
ing to the row. Since more than one course of action can be carried out 
for a particular item, any number of the ten cells in a row may be scored 
1. Thus for the item concerning Miss Blake, a principal might notify the 
superintendent’s office and also send flowers; 1’s would then be recorded 
in Column A and Column G. 

It is obviously not appropriate to get totals for courses of action by 
columns, since the meanings of the 1’s in any column vary from item 
to item, but the total for all the columns is meaningful. One scoring 
category was derived by simply totaling all the Usual Courses of Action 
taken by a principal. The meaning of this scoring category will become 
clearer in the light of the findings to be reported later; but it seems evi- 
dent that people who take many courses of action are productive and 
tend to see a variety of implications in the items. 

Different systems for scoring the content of courses of action can be 
devised if they are perceived as being classifiable in various ways. One 
system that was considered for classifying the courses of action was in 
terms of their appropriateness as solutions to the problem. Certain 
courses of action might be designated as inappropriate on the basis of 
thorough knowledge of the Whitman School situation. Then one could, 
in effect, put a scoring stencil over the record sheet and count the number 
of inappropriate courses of action carried out by a particular examinee. 
In the case of the item involving Miss Blake, the second course of action 
(obtaining a substitute without involving the superintendent’s office) 
would probably be classified as inappropriate because the Staff Hand- 
book for the Jefferson schools specifically prescribes a different proce- 
dure. The scoring of courses of action in terms of appropriateness had 
to be abandoned, however, primarily because it was not possible to de- 
termine the appropriateness of a large majority of the courses of action 
that were taken. It proved to be impossible to obtain a reasonable de- 
gree of consensus among qualified judges as to the appropriateness of 
the different courses of action. 
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Another way of looking at the content of the courses of action is in 
terms of their imaginativeness. Several members of the research staff 
went through all the courses of action and selected those which they 
thought were in some degree creative or imaginative, and eventually, 
after much discussion, a scoring key was developed. For example, the 
response to Miss Blake’s telegram “Use (or consider using) Miss Ash 
as substitute’ (regardless of the merits of choosing Miss Ash) does re- 
quire a certain amount of ingenuity, since Miss Ash is introduced in a 
different context in a different item. Being imaginative was defined as 
choosing courses of action that are “good ideas,” that go beyond the 
actions immediately suggested by the stimulus materials. The Imagina- 
tiveness score is the number of courses of action keyed as imaginative 
that were taken by a principal. It is to be expected that the content 
score, Imaginativeness, will be correlated with certain of the stylistic 
scores because of similarities in definitions. 

A third procedure for scoring the content of the courses of action 
was in terms of Organization Change. For this score those courses of 
action were keyed which involved (1) changes of personnel (through 
hiring, firing, or transfer), (2) change of duties or assignments of per- 
sonnel which go beyond a single task or assignment, and (3) change of 
a policy, practice, or procedure. This last category would include, for 
example, efforts to improve cooperation among staff members, provided 
the efforts go beyond a single problem or assignment. The score on this 
measure reflects the extent to which the subject introduced or considered 
introducing changes into the organization. Eighty-seven courses of ac- 
tion from the three school in-baskets and 83 from the Bureau of Busi- 
ness in-basket were keyed for the Imaginativeness score. The compara- 
ble numbers were 28 and 42 for the Organizational Change score. The 
maximum possible score across all four in-baskets for Imaginativeness 
was therefore 170, and for Organizational Change, 70. Since the courses 
of action so keyed tended to be rather uncommon ones, the means may 
be expected to fall much below these upper limits. 


RATINGS OF IN-BASKET PERFORMANCE 


Thus far two major methods of scoring have been described, one 
based on content and the other on style. Both require an analytical ap- 
proach to the principals’ responses. It is also possible to view the re- 
sponses more subjectively and globally. A third method of scoring 
required the scorer of the in-basket to make over-all judgments about 
each principal as the final step in the scoring procedure. The last page 
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of the Score Sheet is called the Over-all Rating Form. It presents, first, 
21 pairs of adjectives, with instructions to check the one of each pair 
which best describes the principal’s behavior. Examples of the pairs are 
as follows: 
Friendly—Aloof 
Slipshod—Painstaking 
Cold-hearted—Genial 
Logical—Intuitive 
Witty—Humorless 
Next, the scorer was asked to answer each of three questions by 
circling a number on a rating scale. The three questions were as follows: 
1. On the basis of what you know about the Subject, how well do you 
think he would perform as the principal of Whitman School (or as 
the executive officer of the Northeastern Division of the Bureau of 
Business ) ? 
2. How popular would you judge the Subject to be with his staff? 
3. How well do you like the Subject? 


EVALUATION VS. DESCRIPTION IN SCORING 


It will be noted that judgments of “‘goodness” or “badness” of the 
in-basket responses have been avoided in the scoring of individual in- 
basket items. Evaluative judgments were made by the scorers only in 
the final step in the scoring process, as just described, and were involved 
to some extent in the designation of certain courses of action as imagina- 
tive. The predominant approach to scoring, however, was one that pro- 
vided a rather complete description of administrative behavior with a 
minimum of value judgments. 

The primary purpose of the scoring system was to provide a method 
for describing a principal’s administrative behavior in terms of a rela- 
tively small number of attributes or variables. Some evidence will be 
presented in this study as to the relation of these attributes to judgments 
of quality of administrative behavior. But it will be the job of future 
studies to determine more precisely to what extent, or under what con- 
ditions, these attributes are good or bad. 


THE SCORING SYSTEM 


THE SCORE SHEET 

The Score Sheet has already been described in a fragmentary way. 
It is actually a seven-page booklet. Pages 2 to 6 consist of cells formed 
by rows, representing in-basket items, and columns, representing scoring 
categories. The task of the scorer was to place entries in these cells to 
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indicate whether (or, in the case of some categories, to what extent) 
the behavior described by the scoring category was exhibited on the item. 
Each item can be thought of as providing an opportunity for each cate- 
gory of behavior to appear. The column totals indicate how often the 
behavior did appear. 

In the case of those columns which pertain to content scoring, the 
procedure is somewhat different, as has already been suggested. For these 
columns, each cell has a unique meaning which is defined by one of the 
assigned courses of action for that item. 

Two forms of the Score Sheet were used. On one form only odd- 
numbered in-basket items appeared and on the other, only even-num- 
bered in-basket items. The two forms were used because, for the purpose 
of obtaining estimates of reliability, odd- and even-numbered items were 
scored by different scorers. 


THE SCORING MANUAL 

Essential to the operation of a successful scoring procedure was the 
development of a Scoring Manual for use by scorers. It contains 165 
pages of rules, definitions, and examples to which a scorer referred when 
she encountered a scoring problem. 

The Scoring Manual started with a brief description of the in-basket 
test and what is entailed in scoring it, a list of suggested steps in scoring, 
and a set of general instructions. The bulk of the Manual is composed of 
lists of courses of action for the items in all in-baskets, and detailed defi- 
nitions, rules, and examples for use in scoring each behavior category. 
Illustrations of courses of action have already been given. An illustration 
of the definitions and rules for scoring other categories of performance 
follows. 


DELAYS OR POSTPONES DECISION, OR TEMPORIZES 


General Definition: Score here if the S. clearly delays or postpones decision 
on the item. Score also any response communicated to another that indicates 
that the S., after having considered the item, is unwilling to commit himself 
to a decision or to a leading action at the present time; e.g., in response to a 
request of some sort, the S. neither complies fully nor refuses to comply, but 
merely stalls for time by stating that he will think about it, study it, get 
further information, etc., but takes no steps to get the further information. 


Rule a: Do not score here if the S. has done any further degree of de- 
ciding, i.e., if his response is scored for Arrives at a Procedure for De- 
ciding, Contingent Decision, or Concluding Decision. 

Rule b: If the S. merely postpones, score here, but do not score in Plans 
Only, or in Work Scheduling. If he postpones until a specific time, score 
here and in Work Scheduling, but not in Plans Only. 
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SELECTION AND TRAINING OF SCORERS 


The people employed as scorers were wives of graduate students or 
professional men. They were carefully selected on the basis of a vocabu- 
lary test, a reading comprehension test, and an interview. All had at- 
tended college and some had advanced degrees. About a dozen scorers 
and three checkers were involved in scoring the in-baskets. Each scorer 
was assigned to one-half of one particular in-basket. 

The first step in training a scorer was to require her to take the part 
of the in-basket test which she was expected to score. The scorer was 
asked to study all the background material carefully before taking the 
test and, after taking the test, to study the Scoring Manual. 

Next, the scorer-trainees met with a staff member for their first ex- 
perience in scoring. A set of in-basket responses had previously been 
scored by the staff and were duplicated for use by the trainees. Using 
these duplicated materials, the staff member went through the entire 
process of scoring with the trainees, explaining why each response was 
scored as it was and making sure that they understood the definitions 
and rules. 

At the next session, another set of duplicated in-basket responses 
was used, but this time the trainees were allowed to score the responses 
with immediate knowledge of results as supplied by the staff member. 
Again efforts were made to clarify definitions and rules and to identify 
unique problems that arose in connection with the scoring of particular 
items. 

After the second session, still another set of duplicated responses 
was distributed to the trainees, this time with instructions to score them 
at home. The third session was devoted to criticizing the work of the 
trainees. 

The final session was devoted to further discussions of the unique 
aspects of various items from the standpoint of scoring. Each trainee 
was then ready to begin scoring the actual in-basket tests, at first under 
rather close supervision. 

Approximately two weeks, on a half-time basis, was required to train 
a scorer before she could perform at an acceptable level of accuracy. 
Not all trainees passed the requirements and not all those who passed 
succeeded in maintaining the standards of accuracy required for the 
study. 


CONTROL OF THE QUALITY OF SCORING 


The quality of the scorers’ work was evaluated by using quality con- 
trol procedures analogous to those employed in industry. The managers 
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of a factory producing light bulbs might decide that a given lot of bulbs is 
satisfactory if it contains no more than, say, .2 per cent defective bulbs. 
However, it is not feasible to test every light bulb in the lot, and, fur- 
thermore, the fact that a given light bulb passed the test cannot be ac- 
cepted as infallible evidence that it is a “good” bulb. A more economical 
procedure than testing every bulb is needed for deciding whether to 
accept or reject a given lot. 

The problem of checking scoring accuracy is similar. It is necessary 
to accept some errors in scoring, and the best that can be accomplished 
is to be able to state with a known degree of confidence that the propor- 
tion of errors is not greater than some specified level. In scoring re- 
sponses to an in-basket item, the test of scoring accuracy consisted of an 
independent rescoring of the items. This is obviously a fallible test, 
since the checker could also make errors. As in the case of quality 
control in industry, the volume of work to be done precluded rescoring 
every item. 

The method used to control the accuracy of scoring was based on a 
paper prepared by Ratoosh® which in turn was an adaptation of Wald’s* 
sequential analysis procedures. One begins by testing a small sample 
from a lot; if the lot can be accepted, no further checking is necessary. 
But if for the sample tested the lot can be neither accepted nor rejected, 
one continues sampling until a decision can be made about the quality 
of the lot. 

The procedure was ordinarily applied to each scorer individually; 
that is, a “lot” was the work of a single scorer. For the accuracy and 
confidence levels desired (to be discussed later), it turned out that a 
minimum of 56 items would need to be checked in order to accept the 
lot as satisfactory. As soon as a scorer had scored his first lot of in- 
baskets, the test was applied. A total of 56 items was chosen from the 
lot one at a time on the basis of a list of random numbers. These items 
were rescored independently by the check scorer on all scoring cate- 
gories, and a comparison was made for each category with the scores 
given by the original scorer to determine the number of agreements. 
(The item was replaced in the lot after it had been checked.) By re- 
ferring to a nomograph prepared for the purpose, one could deter- 
mine whether for that sample the proportion of agreements was (1) 
great enough to accept the entire lot, (2) small enough to reject the 

*Philburn Ratoosh, A Sequential Sampling Inspection Scheme for Determin- 
ing the Mean of a Binomial Distribution When the Test for Inspection Is Not Per- 
fectly Valid. Unpublished paper, 1955. 


* Abraham Wald, Sequential Analysis (New York: John Wiley & Sons, Inc., 
1947). 
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lot, or (3) required the examination of a larger sample before a deci- 
sion could be reached. 

In developing a nomograph for determining the result of the testing 
of each lot, it was necessary to estimate the probability that the checker 
was correct. This probability was arbitrarily set at .98. It was also de- 
cided arbitrarily that the lot would be accepted if the “true” proportion 
of correct scorings was .95 or higher, and that the lot would be rejected 
if the “true” proportion was .90 or lower. Some absolute values result- 
ing from the standards so set are as follows: 


TABLE 11. Standards for acceptance or rejection 


Number of items checked 56° 66° 76°) SCHR OmmetuG 
Number of disagreements which permit 

lot to be accepted 0 1 a 3 4 5 
Number of disagreements which cause 

lot to be rejected 10. 11 . J25g see 15 


Thus, if there were no errors in a random sample of 56 items, the 
entire lot was judged satisfactory; but if there were 10 or more errors in 
that sample, the lot was judged unacceptable. If the number of errors 
was greater than 0 but less than 10, the testing was continued, increasing 
the size of the sample. Sampling was on an item basis, and all cate- 
gories were checked at the same time for the same sample of items. 

Certain modifications of the procedure were introduced because 
of the large number of category scores involved in the testing of a 
sample. It was arbitrarily decided that the lot would be accepted 
as adequately scored on all categories if no categories were rejected 
by the above method, and if no more than three categories were 
in the uncertain region. If, with a sample as large as 106, the above 
criterion of acceptability was not met, the lot was rejected, rescored, and 
then re-examined. Without such a limit, it would have been possible to 
continue sampling indefinitely without reaching a decision. 

Information from the rescoring was, of course, fed back to the 
scorers. Steps were taken to identify the nature of the scorers’ difficul- 
ties, and attempts were made to retrain the scorers. Most scorers were 
able to profit from this form of retraining and to perform at an accept- 
able level thereafter. 

It was soon discovered that for a number of categories the standards 
originally set were too high and simply could not be met. Consequently, 
less rigorous standards were set for such categories. The new standards 
involved the assumption that the proportion of accurate check scores 
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were .95 (instead of .98) and required that the proportion of correct 
scorings be .80 or more for acceptance and .75 or less for rejection. The 
absolute values associated with the revised standards are as follows: 


TABLE 12. Revised standards for acceptance or rejection 


Number of items checked 0 me Of Onn Ona 0 Our LUO 
Number of disagreements which permit 

lot to be accepted 2 4 i ORL 2 1S 
Number of disagreements which cause 

lot to be rejected 2 ae Pe 2k Se iS) 39 


Twenty of the 68 scoring categories were in the group for which 
lower standards were set. These included the following scoring cate- 
gories: 


Unusual Courses of Action 

Conceptual Analysis 

Discusses with Subordinates 

Asks for Information, Opinion, Advice, or Permission from Subordinates 
Requires Further Information 

Arrives at a Procedure for Deciding 

Concluding Decision 

Makes Tentative or Definite Plans Only 

Work Scheduled: Indefinite Time or No Time Specified 
Takes Leading Action 

Takes Terminal Action 

Follows Lead by Subordinates 

Follows Lead by Superiors 

Follows Lead by Outsiders 

Follows a Pre-established Structure 

Initiates a New Structure 

Gives Directions and/or Suggestions 

Gives Information to Subordinates 

Gives Information to Superiors 

Gives Information to Outsiders 


SCORING PROCEDURES 

The general procedure used in scoring involved assigning one scorer 
to the odd-numbered items and another to the even-numbered items in 
each in-basket, making a total of eight scorers needed. Each scorer 
thus became a specialist and was thoroughly familiar with the subtleties 
of each of her 16 or 17 items and all of the many courses of action 
found in the responses to these items. The schedule for completion of 
the project demanded that each scorer, working on a part-time basis at 
home, score 15 half in-baskets per week. Scorers were paid on a piece- 
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rate basis. Some scorers easily maintained this schedule while others 
for various reasons could not. Consequently, the ideal of one scorer 
for each half in-basket could not be maintained. In a few cases more 
than one scorer was involved in the scoring of odd- or even-numbered 
items of a particular in-basket. On such occasions, the sequential sam- 
pling technique was applied to the scorers who collectively were in- 
volved in the scoring of a particular half in-basket. 

No complete or systematic rescoring of in-baskets was undertaken, 
and consequently no “scorer reliability” can be reported. Scorer reli- 
ability could be defined as the correlation between scores resulting from 
the independent scoring by two scorers of the same in-baskets. The re- 
liabilities reported in Chapter 7 all involve correlations between differ- 
ent sets of in-basket items; they therefore reflect both the unreliability 
of scoring and the inconsistency in behavior of the examinees. 


THE SCORING CATEGORIES 


In this section all the 68 scoring categories are described in suffi- 
cient detail to enable the reader to interpret for himself some of the 
findings to be reported later. These descriptions are abstracted from 
the Scoring Manual. 

Table 13 shows the means and standard deviations of the category 
scores for the total of all four in-baskets, for the three school in-baskets, 
and for the Bureau of Business in-basket. The scores on which these 
means and standard deviations are based were obtained by adding the 
numbers recorded by the scorers in the appropriate columns of the in- 
basket score sheets. For the total score, the mean scores are based on 
the totals for the three school in-baskets and the Bureau of Business in- 
basket, comprising 132 items. The means for the three school in-baskets 
are based on 96 items, and for the Bureau of Business in-basket on 36 
items. 

Estimated Number of Words (Number of Words). The scorers 
were instructed to estimate, not actually count, the number of words 
written in response to each item. The numbers entered on the score 
sheet are coded values with the following meaning: 


0 = nothing written 

1 = very short (1—6 words) 

2 = short (7-15 words) 

3 = medium (16—40 words) 

4 = long (41-100 words) 

5 = very long (101-200 words) 

6 = extremely long (more than 200 words) 
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The scoring rules defining what constitutes a word are spelled out in 
detail in the Manual. 

When the mean total score (in the top row of Table 13) was di- 
vided by 132, the number of items in all in-baskets, the mean code 
value per item was found to be 2.5—midway between short and me- 
dium. The “typical” response therefore involved about 15 words. 

Number of Items Not Attempted (Items Omitted). In scoring for 
number of words written, a special code (9) was used to indicate that 
the item was not attempted. The fact that the examinee wrote nothing in 
response to an item did not necessarily mean that he did not attempt it. 
For example, in the Reasons-for-Action Form the subject might say, 
“Not a pressing problem—postponed,” or “This needs more work than 
I can give it today.”” Such responses showed that some analysis of the 
item had been made. The item was coded 9 (not attempted) only when 
there was no evidence that the subject had made any attempt to analyze 
the item. The code 9 would be used when no words were written and 
the Reasons-for-Action Form was left blank or contained such comments 
as “Did not get to” or “No time.” 

The number of items omitted on the average was about 2.6 per in- 
basket (one-fourth of the mean for Total, since the total was based on 
four in-baskets ). 

Usual Courses of Action (Usual Actions). As described earlier in 
this chapter, the courses of action which occurred most often were identi- 
fied for each item, and ten columns of the score sheet were reserved for 
recording the presence or absence of each identified course of action for 
each problem. The number of courses of action is the sum of these 
courses of action over all ten columns and all items. The average num- 
ber of courses of action per in-basket was about 41 (out of about 210 
possible). On the average, the subject thus took slightly more than one 
course of action per item. 

Rejection of Test Conditions. This variable was not intended as a 
measure of administrative performance, but was included to provide 
information pertinent to the question of how successful was the simula- 
tion of the principal’s job. The scorers recorded a 1 under Rejection of 
Test Conditions whenever the principal failed to follow certain of the 
test conditions. This category was scored if, for example, the examinee 
made a comment directed to the research staff, or if he “fabricated.” 
The most usual reason for scoring this category was the latter; fabrica- 
tion was scored whenever the subject invented conditions other than 
those described by the test materials or other than those under his own 
control. Fabrication was scored, for example, if the subject invented a 
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two-way telephone conversation or assumed there was a group such as 
the Jefferson Anti-Vivisection League. 

Rejection of test conditions occurred infrequently. The mean was 
about one occurrence per in-basket. 

Number of Subordinates Involved Individually (Subordinates In- 
volved). This is another of the categories in which the scorer could 
record a number greater than one. The number represents the number 
of subordinates individually involved in the solution to a problem. If, 
for example, a principal called a meeting to be attended by a teacher, 
a parent, and a reading consultant, the scorer would record 2, since 
both teacher and reading consultant would for this purpose be classified 
as subordinates. The Manual specified the persons who are considered 
subordinates and what constitutes involvement. A subordinate was con- 
sidered “involved” only if it was clear that the subordinate would come 
to know about the principal’s course of action through the action itself, 
whether the action was actual or merely planned, and no matter how 
deeply or superficially the subordinate was involved. 

The same subordinates might, of course, be counted more than once 
in the subject’s total score, since the score was the sum of the entries in 
the category column. The mean number of subordinates involved per 
in-basket was about 25. 

Number of Subordinate Groups Involved (Subordinate Groups In- 
volved). This category was scored in the same manner as the preced- 
ing one, except that groups were involved instead of individuals. Calling 
a meeting of the faculty, planning a meeting of all the third-grade teach- 
ers, or planning a school assembly would be examples of involving sub- 
ordinate groups. Subordinate groups were involved about eight times 
per in-basket. 

Number of Superiors Involyed (Superiors Involved). The involve- 
ment of superiors was scored in a manner similar to the above, and 
again, the same people may be involved repeatedly. As a matter of fact, 
in the Bureau of Business in-basket there was only one superior who 
could be involved, so the category might better have been called “num- 
ber of times the vice-president is involved.” In the school in-basket, the 
superiors were the superintendent (or his office or his secretary), the 
two assistant superintendents, or the Board of Education. 

Involvement of superiors was a much less common occurrence than 
involvement of subordinates. It happened about four times per in-bas- 
ket. 

Number of Outsiders Involved Individually (Outsiders Involved). 
This category was scored in a manner similar to the above. In the 
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school situation, outsiders included such people as parents, city officials, 
and members of PTA groups. In the Bureau of Business, outsiders were 
most often dues-paying members of the Bureau of Business. Outsiders 
were involved, on the average, nine or ten times per in-basket. 

Number of Outside Groups Involved. Outside groups included or- 
ganizations such as the League of Women Voters or the Parent-Teacher 
Association. Involvement of outside groups was scored if the examinee 
did not single out individuals. This category was scored, on the average, 
only a little more than twice per in-basket. 

Unusual Courses of Action (Unusual Actions). Under this category 
heading, the scorer recorded 1 if the subject took any action not listed 
in the courses of action which were used in the content scoring, except 
that trivial actions such as typing, filing, delaying, holding for later study, 
etc., were not scored as unusual actions. 

Since the scoring rules called for O-1 scoring rather than the num- 
ber of unusual actions, the total score cannot be rigorously used as the 
total number of unusual actions. However, if it is assumed that no more 
than one unusual action per item was taken by any candidate (as was 
usually true), there were about five or six unusual courses of action per 
in-basket, on the average, as compared with about 41 usual courses of 
action. It therefore appears that the great majority of ways of respond- 
ing to items had been identified in the procedures used in establishing 
the courses of action. 

It is tempting to think of Unusual Actions as a score which reflects 
creativity in problem solving. From the description of the method of 
scoring, however, it can be seen that strictly speaking the score means 
merely the number of actions taken that did not get tabulated in the 
list of courses of action. Unusual actions may reflect either genius or 
stupidity. Other evidence may reveal something of the nature of this 
variable. 

Gives Recognition for Ability or Good Work (Recognition for Good 
Work). This category was scored whenever the subject commended a 
subordinate for doing good work or otherwise showed that he recog- 
nized a good job or high ability. An example of recognizing good work 
was, ““Thank you for drafting the letter to Mrs. James. It was very well 
written.” 

Ordinarily, good work could not be recognized unless a subor- 
dinate’s work was available for inspection. Here is a case where the 
number of opportunities did not quite equal the number of items in the 
in-baskets. Even in the light of this, recognition of good work was 
rather rare; it occurred on the average less than once per in-basket. 
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Shows Awareness of Poor Work (Aware of Poor Work). This cate- 
gory is somewhat analogous to the preceding one, except that it is not 
limited to the work of subordinates and that only evidence of awareness 
is necessary for scoring—the subject need not actually reprimand a 
subordinate, for example. Noticing anything from poor typing to ill- 
advised plans would be scored. Awareness of poor work occurred about 
twice as often as recognizing good work, possibly because more poor 
work than good work of subordinates was presented in the in-baskets. 

Carelessness or Minor Error (Careless). This category has to do 
with whether the examinee himself committed an error. In order to in- 
crease scoring accuracy, scoring this category was permitted for four 
specified types of error: checking or signing a buck slip or form in the 
wrong place, confusing or misspelling names or positions of people, us- 
ing a wrong date, and omitting or misspelling a word. Such errors were 
relatively uncommon. On the average, fewer than two errors per in- 
basket were found. 

Socially Insensitive. This category was scored when the subject 
carried out or planned to carry out an action which might be uninten- 
tionally offensive to someone, or unnecessarily hurt someone’s feelings. 
Every item presented an opportunity for the subject to be socially in- 
sensitive. In addition, certain items were included in the Bureau of 
Business in-basket which were made specifically for the purpose of 
measuring this characteristic. One item, for example, involved a sub- 
ordinate proposing a form letter for use in a certain situation. The let- 
ter contained sentences which could be construed as reflecting unfavor- 
ably on the recipient. Approval of the letter without changing these 
sentences was scored as Socially Insensitive. 

Social insensitivity almost never occurred in the school in-basket; 
but it was scored almost three times per in-basket, on the average, for 
the business situation. Apparently social insensitivity was rare as an 
aspect of spontaneous behavior. It is also possible, of course, that social 
insensitivity is thought to be more acceptable in a business setting than 
in a school. 

Relates to Background Material or to Other Items (Relates to Other 
Materials). This category refers to the subject’s seeing the item in re- 
lation to information previously presented to him or which is in some 
other part of the in-basket. Explicit use of background materials in solv- 
ing a problem was scored here, even if it merely involved looking up a 
name. Seeing two items as related in some way would also be scored; 
for example, thinking of Miss Ash (who was presented as someone who 
needed part-time work) as a possible substitute for the ill Miss Blake 
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was scored here. Such behavior was scored, on the average, about six 
times per in-basket. 

Conceptual Analysis. Conceptual analysis has to do with the sub- 
ject’s perceiving the problem as involving more than was immediately 
obvious in the stimulus materials. For example, if the subject general- 
ized from the specific case and saw additional implications of the prob- 
lem, or if he saw the problem in relation to a larger situation, Concep- 
tual Analysis was scored. Seeing morale or public relations implications 
of an action is an example of Conceptual Analysis. If, when the subject 
heard of a couple of problems involving field representatives in the Bu- 
reau of Business, he raised the general question of how well field repre- 
sentatives were being supervised, he was scored for Conceptual Analysis. 

Conceptual Analysis was not a particularly common type of be- 
havior, since it was scored less than three times per in-basket, on the 
average. 

Prejudges, Makes Unwarranted Assumptions, or Largely Inappropri- 
ate Perception (Prejudges). As is implied by the way this category is 
named, it resulted from the combination of three notions about stylistic 
variations in in-basket responses. The three were combined because 
separately their occurrence was too rare to yield dependable scores, and, 
of course, because they appeared to have something in common. As will 
be seen in Chapter 7, this combination seems justified. 

Prejudging was shown by a subject acting, or planning to act, with- 
out being adequately informed on both sides of an issue. For example, 
if he received a letter in which a parent made an accusation against a 
teacher and acted as though the charge were true, making no attempt to 
verify it, a score would be recorded. Making unwarranted assumptions 
involves a related concept. The category was scored when the subject 
acted or planned to act in a manner which implied assumptions for 
which there was no actual basis. Similarly, when the subject’s response 
revealed that he misunderstood the item, he was scored on this category. 

Even when the three notions were combined, the category was, on 
the average, scored rather infrequently—slightly more than once per 
in-basket. 

Uses Human or Personal Values in Analysis (Human Values). 
Whenever the subject showed, in his response or in his explanation on 
the Reasons-for-Action Form, that he explicitly took account of human 
welfare or happiness in his analysis of the problem, the response was 
scored for Human Values. For example, in one item a parent wrote a 
letter demanding that the school psychologist cease seeing her daughter; a 
response which clearly shows that consideration for the welfare of the 
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child was a factor in what was done about the letter would be scored 
here. 

This category was scored on the average of less than once per in- 
basket. 

Uses Physical Values in Analysis. This category was similar to Hu- 
man Values except that it involved concern for buildings and equip- 
ment. Use of this category by scorers was extremely rare. 

Uses Program Values in Analysis (Program Values). This category 
was similar to the preceding ones, but it involved concern for things 
pertinent to the successful accomplishment of the purposes of the school 
(or the Bureau of Business). If the subject showed concern for com- 
munity support of the school, public relations, the instructional program, 
educational opportunities for children, and the like, he was given a score 
on this category. 

A response scored for Program Values was almost always scored 
also for Conceptual Analysis; but the reverse of this statement was not 
true. Conceptual Analysis was actually scored most often because of 
responses which expressed concern for possible public relations prob- 
lems. 

Concern about Program Values was much more common than for 
Human or Physical Values, but still quite uncommon. The mean score 
per in-basket was about 1.6. 

Discusses with Subordinates. This category was a simple one to 
score. A 1 was recorded for any response which indicated that the sub- 
ject made or planned to make arrangements for a discussion with a 
subordinate or subordinates. The proposed meeting must have clearly 
involved a two-way give and take, not merely the giving or getting of 
information. 

Discussions were planned typically in response to about seven items 
per in-basket. Thus the responses to between a fifth and a quarter of 
the problems involved having discussions with subordinates. 

Discusses with Other Principals. This category of behavior also in- 
volved discussions, but with principals of other Jefferson schools. This 
behavior, of course, did not occur at all in the business situation, and it 
was rare in the school in-baskets, perhaps because the background ma- 
terials did not include very much information about other principals. 
This kind of behavior occurred only about once in every three in-bas- 
kets. 

Discusses with Superiors or Outsiders (Discusses with Superiors). 
In this category the discussions were typically with people from the su- 
perintendent’s office, parents, PTA officers, and the like. Discussions 
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with superiors or outsiders were planned less than half as frequently as 
with subordinates—about three times per in-basket on the average. 

Asks for Information, Opinion, Advice, or Permission from Subordi- 
nates (Asks Subordinates). This category included any effort, actual 
or planned, to get information, advice, opinion, permission, and the like 
from a subordinate. Even the response of writing a reminder to “check 
with Miss Blake” was scored here. Getting information and advice from 
subordinates was a fairly common type of behavior; it typically occurred 
between four and five times per in-basket. 

Asks for Information, Opinion, Advice, or Permission from Superiors. 
This category is the same as the preceding one except that it involved 
superiors instead of subordinates. Superiors were asked for informa- 
tion, advice, etc., much less often than subordinates—less than once 
per in-basket, on the average. 

Asks for Information, Opinion, Advice, or Permission from Outsiders. 
Asking outsiders occurred only slightly more often than asking superiors 
for information or advice. 

Requires Further Information (Requires Information). Any re- 
sponse by a subject which explicitly indicated that he needed additional 
information before making a decision was scored here, regardless of 
whether he took any action to secure such information. An indication 
of a need to study or think about a problem was not scored. In a typical 
in-basket, need for information was expressed in the responses to about 
five of the 32 items. 

Delays or Postpones Decision, or Temporizes (Delays). A response 
was scored here if the subject clearly delayed or postponed a decision on 
the item. Merely omitting or not attempting the item was not scored; 
but if the subject indicated by his response that he had given some con- 
sideration to the item and was unwilling to commit himself to a decision 
or leading action, the response would be scored under this category. 
The response, “l’ll have to think about it,” in answer to a request for 
a decision, is an example of delaying. A statement indicating need for 
further information without taking any steps to get the information would 
also be scored. 

The mean score for delaying was about 2.4 per in-basket. 

Arrives at a Procedure for Deciding (Decides on Procedures). Sevy- 
eral types of decision-making processes were distinguished in setting up 
the scoring categories, one of which is called Arrives at a Procedure for 
Deciding. This was scored when the subject set up the procedures to be 
used in reaching a decision about the problem posed by the item. One 
commonly used procedure for deciding how to solve a problem was toa 
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have a discussion; therefore this category would likely be scored each 
time a category like Discusses with Subordinates was scored. Other 
procedures for deciding were appointing a committee, getting informa- 
tion, and getting advice from superiors. This category was scored only 
when there was an indication that the subject expected to be involved 
in the decision making later on. 

Procedural decisions were quite common, and they most often in- 
volved discussions with subordinates. Procedural decisions were made, 
on the average, about ten times per in-basket. 

Contingent Decision. Another type of decision making which can 
be distinguished in the responses is the Contingent Decision. A con- 
tingent decision typically involved the “if... then” or “unless... 
then” notion. For example, the subject may write, “If what they say 
about Jeffries proves to be true, I will fire him.” Contingent decisions 
were not frequently found in the responses; the mean was less than one 
per in-basket. 

Concluding Decision. When the problem was disposed of in any 
final way, Concluding Decision was scored. This category was scored 
whenever the subject showed that he had made up his mind about what 
to do about an item regardless of whether action was taken. Most deci- 
sions made in the in-basket situation were of the ‘“‘concluding” variety, 
the mean score being about 16 per in-basket. 

Makes Tentative or Definite Plans Only (Plans Only). The em- 
phasis in the name of this category is on the words Plans Only. It was 
scored when plans were made, either tentatively or definitely, but no 
action taken toward carrying out the plans. The Scoring Manual empha- 
sizes that if any action is taken, even trivial action, on the plans, the 
category is not to be scored. Plans Only is likely to take such form as 
writing a reminder to oneself or writing an agenda or a list of “things to 
do.” 

There was a much greater tendency to plan without acting in the 
school situation (where the mean for one in-basket is about 10) than 
in the Bureau of Business in-basket (mean = 1.5). The difference is 
probably due to the greater proportion of items in the Business in- 
basket which call for prompt action. 

Work Scheduled for Same or Following Day (Immediate Work Sched- 
uled). Three scoring categories were used to find out something about 
how immediately and how precisely the subject scheduled his work. If 
the subject specifically scheduled an activity for himself—say a meeting, 
phone call, or writing a letter—for later the same day or the following 
day (“today” or “tomorrow’’), he was given a 1 for Work Scheduled 
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for Same or Following Day. Work accomplished during the test period 
was not counted, nor was work started but not completed during the 
test period. Only actions initiated by the subjects were scored. Sched- 
uling work for the near future occurred about four times per in-basket. 

Work Scheduled for Same or Following Week (Intermediate Work 
Scheduled). This category specifically excluded work scored under 
the previous category, and therefore included work planned for 2 to 14 
days after the test day. Matters scheduled for this period were scored 
whether or not a definite day or hour was set. Scheduling future work 
occurred about three times per in-basket, on the average. 

Work Scheduled: Indefinite Time or No Time Specified (Indefinite 
Work Scheduled). In this category the scorers recorded actions in 
which the subject clearly planned activities for himself to be done at a 
later time, but where no indication was given as to when the job was to 
be done. In order to be scored here, there had to be some indication 
that the subject would be involved personally in the later action. The 
mean frequency per in-basket was about 10. 

Takes Leading Action (Leading Action). This category had to do 
with taking (not mere planning) some action which has the effect of 
getting things moving toward a solution to the problem, but which falls 
short of Terminal Action. In Leading Action there is the expectation 
that the subject will later take other actions which will be final. Calling 
a meeting to discuss a problem, writing a memorandum asking for in- 
formation needed to solve the problem, having a subordinate draft a 
letter for the subject’s approval would all be scored as Leading Action. 
Leading actions were common, occurring about 10 or 11 times per in- 
basket. 

Takes Terminal Action (Terminal Action). Terminal Action was 
scored when the subject took action which assured him that no part of 
the problem posed by the item would require his attention again. Sign- 
ing a letter or a report or completely delegating a task to a subordinate 
are examples of Terminal Action. While future events may raise other 
related problems if their specific nature is not known to the subject, the 
action may be scored as terminal. Roughly half the actions taken were 
leading and half were terminal, over all in-baskets. 

Follows Lead by Subordinates (Follows Subordinates). A response 
was scored here if the subject complied or planned to comply with a sug- 
gestion or request explicitly addressed to him by a subordinate. For 
example: The subject is requested by a teacher to telephone a parent, 
and he plans to do so; a letter is prepared for the subject’s signature, and 
he signs the letter (without revision); the subject is requested to speak 
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at a teachers association meeting, and he accepts the invitation. The 
Scoring Manual specifies for each item whether or not there was a lead 
and from whom it came, so the scorer had to judge only whether the 
subject followed the lead. There were, on the average, twelve leads by 
subordinates per in-basket, and the mean score was about 7. 

Follows Lead by Superiors (Follows Superiors). This category is 
the same as the preceding one, except that the lead came from a superior. 
There were about six leads by superiors in a typical in-basket, and the 
mean score for following leads from superior was almost 5. 

Follows Lead by Outsiders (Follows Outsiders). Here the leads 
came from people outside the organization. In the typical in-basket 
there were ten leads by outsiders, and the mean score on Follows Out- 
siders was 5.4. 

Follows a Pre-established Structure (Follows Structure). Pre-estab- 
lished structure has to do with the rules, routines, procedures, policies, 
customs, regulations, and so on, which appear to be in effect in the or- 
ganization at the time the subject takes the in-basket. A response was 
scored here if the subject followed pre-established structure without 
being specifically instructed to do so. The Manual lists a number of ac- 
tions which come under this category—distributing or announcing in- 
formation to the staff, signing standard forms, having the secretary 
mimeograph or distribute something, filing, referring problems to exist- 
ing committees or to individuals whose duty it is to handle such prob- 
lems, and returning telephone calls. Pre-established structure was typi- 
cally followed about nine times per in-basket. 

Coordination. Coordination was defined as making specific at- 
tempts to arrange activities in such a way as to promote efficiency, avoid 
conflict, or produce interlocking of some sort between activities which 
would otherwise be independent. An example of Coordination would 
be the circulation of a letter or other document for information to people 
who are not directly concerned with its contents, but might need to 
know about it. It turned out that there were very few instances of per- 


_formance which were scorable under this category; Coordination oc- 


curred only about once in every three or four in-baskets. 
Initiates a New Structure (Initiates Structure). Structure-in-inter- 


action, according to Hemphill,® is any consistency in behavior occurring 


during interaction that permits one to predict behavior that will occur 


in future interaction. Initiates Structure, then, was conceived of as any 


act by the subject which tended to produce such consistency in behavior 


* John K. Hemphill, op. cit. 
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on the part of members of the organization. Accordingly, this category 
was defined as any response which indicated that the subject was de- 
veloping or putting into use a new procedure involving a subordinate 
which he devised to fit a specific problem. Appointing a committee to 
deal with a problem or class of problems, or changing a subordinate’s 
duties or responsibilities would be scored here. Such acts tend to pro- 
duce consistencies in behavior such as are implied by the term structure- 
in-interaction. 

One of the scoring rules was, “Score here-if the S. discusses, or 
plans to discuss, with one or more subordinates.” This rule permitted 
the inclusion of a type of behavior which is a rather weak example of 
initiating structure. Unfortunately such behavior occurred so frequently 
that it became the principal ingredient of this category. The category 
score therefore cannot be regarded as a very pure measure of initiating 
structure in the sense originally intended by Hemphill. 

The mean score for Initiates Structure is about 12 per in-basket. As 
we have seen, the mean for Discusses with Subordinates is about 7. If 
the rule was followed, 7 of the 12 instances of initiating structure were 
really discussing with subordinates. 

Delegates Completely. Three categories have to do with delega- 
tion. Delegation was defined as deputizing another to act in the subject’s 
place in effecting a task or decision. In other words, an act was con- 
sidered delegation only if it involved assignment of a task which the 
subject himself would normally be expected to do. The duties of the 
principal were spelled out reasonably well in the background material 
for the school in-baskets. For the Bureau of Business in-basket, the 
duties considered to be those of Henry Jackson (the subject’s role in 
the Bureau of Business) were stated in the Scoring Manual. If the 
assignment involved work that the subordinate would normally be ex- 
pected to do rather than the subject, the act was scored under some 
other category such as Gives Directions and/or Suggestions. 

Delegates Completely refers to tasks assigned with no direction, 
guides, control, or evaluation before the task is accomplished. Complete 
delegation therefore implies complete reliance on the delegatee. If a 
report is to be made to the subject for information only, after the action 
has been taken, the act would still be scored as complete delegation. 
Perhaps because of this rather narrow definition, complete delegation 
was found to be rare, the mean score per in-basket being less than .5. 

Delegates Partially with Control (Controlled Delegation). This 
category refers to a task or decision delegated with some guides and with 
control. The amount of guidance must be such that there is still some 
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decision making and initiative left to the delegatee; otherwise the action 
would be scored as Gives Directions and/or Suggestions. By control 
was meant that the subject provided some means for regulating or lim- 
iting the subordinate’s actions on the assigned problem. Control might 
be exercised by asking for a report on plans before they were put into 
effect or by saying something more general, such as “Keep in touch with 
me on this.” Partial delegation with control happened only about once 
in three in-baskets, on the average. 

Delegates Partially but without Control (Uncontrolled Delegation). 
The meaning of this category is obvious from the preceding definitions. 
This was clearly the most common pattern of behavior in delegating; 
but delegation was in general not at all common. Partial delegation 
without control typically occurred only about once per in-basket. The 
mean for delegation of all kinds was about two per in-basket. 

Gives Directions and/or Suggestions (Directs). Any response in 
which the subject gave directions or suggestions to another person (sub- 
ordinate, superior, or outsider) was scored here. In practice, most of 
this behavior involved subordinates. Certain trivial types of behavior 
were specifically excluded, such as telling one’s secretary to type or 
mail something. Directing and suggesting was a frequent type of per- 
formance; it typically occurred about 13 times per in-basket. 

Refers to Superiors. This category was scored if the subject re- 
ferred a decision or task to a superior, provided the decision or task 
was one which the subject might be expected to handle himself. Few 
problems were referred to superiors; this category was scored about once 
in four in-baskets, on the average. 

Communicates Face to Face. This category was scored when the 
subject indicated his intention to communicate face to face with some- 
one. Plans for group meetings or individual discussions in which the 
subject himself planned to participate were included. Perfunctory in- 
vitations, such as “Drop in when you’re in town,” were not scored. 

Considering the fact that the test situation did not permit meetings 
or discussions actually to take place, face-to-face communication was 
very common. The mean score for an in-basket was about 12. 

Communicates by Telephone. This category was similar to the pre- 
ceding category except that it involved use of the telephone. Returning 
a call was included as a scorable response. Telephone communication 
was scored on the average about four times per in-basket. 

Communicates by Writing. Any communication to another person 
that the subject wrote or planned to write was scored. Signing a letter 
or a form prepared by someone else was included. Notes to oneself, 
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such as calendar notations or lists of “things to do,” were not scored, 
nor were the written statements of telephone calls. 

The testing situation, of course, encouraged communication by 
writing; the proportion of written communications would likely be lower 
in the actual job situation. The mean score for an in-basket was almost 
20. 

Gives Information to Subordinates (Informs Subordinates). This 
category was scored when the subject gave or planned to give non- 
trivial, substantive, objective information to a subordinate, whether in 
connection with a specific problem or merely as background information. 
“Reminders” were included as scorable responses. Excluded were giv- 
ing instructions or suggestions, complying or refusing to comply with a 
request, and communicating the subject’s own subjective feelings or 
beliefs. The average score for an in-basket was about 5. 

Gives Information to Superiors. ‘The same definitions applied here 
as above except that information was given to a superior. This category 
was scored much less often than the preceding one; the mean for an in- 
basket was about 1.2. 

Gives Information to Outsiders (Informs Outsiders). The mean for 
this category was about 2.7 per in-basket. 

Explains Actions to Subordinates. Responses scored here were those 
in which the subject explicitly gave his subordinate reasons for an action. 
Most commonly this behavior accompanied the giving of suggestions 
or assignments to a subordinate. For example, the subject might write 
to a teacher, “You had better arrange to discuss this with the child’s 
parents, because the more we can do to improve our relations with 
parents the better.”” One interpretation of explaining actions to subor- 
dinates is that it is a form of considerateness in dealing with subordi- 
nates. The mean score for a school in-basket was .4. 

Explains Actions to Superiors. The psychological interpretation of 
explaining actions is probably different for this category than for the 
preceding one. In any event, this behavior occurred rarely. 

Explains Actions to Outsiders. Here the explanations may be 
thought of more in terms of public relations. But again the behavior 
was rare; the mean for an in-basket was about .4. 

Courtesy to Subordinates. Any expression or act of courtesy to a 
subordinate was scored here. Expressions such as “please,” “thank 
you,” and “sorry” were scored as well as more elaborate expressions of 
solicitude or appreciation or acts which in themselves are courteous. 
Formal salutations and closings of letters were excluded. Courtesy to 
subordinates occurred six times per in-basket, on the average. 
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Courtesy to Superiors. The same definitions as above applied here 
except, of course, for the recipient. The mean score per in-basket was 
only about .4. 

Courtesy to Outsiders. The mean score per in-basket was 1.8. 

Informality to Subordinates. Any communication to a subordinate 
which contained an informal expression of some sort was scored here. 
The use of slang, colloquial language, and first names were all scored as 
informality. The mean score per in-basket was 3.3. 

Informality to Superiors. This behavior occurred rarely—typically 
at the rate of once in five in-baskets. 

Informality to Outsiders. Informality to outsiders occurred even 
less often than informality to superiors. 

Backs Up Teachers or Staff Officers. Backing up the staff has to do 
with giving support to a teacher (or to a staff officer) when that person is 
under attack or involved in a controversy of some sort. Such behavior 
seldom occurred, probably because the in-basket situations did not pro- 
vide many clear-cut opportunities. 

Improves Staff. This category was scored whenever the subject in- 
dicated he planned to provide opportunity for his staff to acquire train- 
ing or otherwise to improve professionally. Even giving encouragement 
to a staff member to do a better job would be scored here. Such be- 
havior occurred rarely, the mean score being .07 per in-basket. 

improves Working Conditions. Under this category would be scored 
any effort or plans of the subject to improve the working conditions of 
the staff, including any aspect of the environment from physical condi- 
tions to emotional tone. This category of behavior almost never ap- 
peared. 

Imposes Controls: Sets a Deadline (Sets Deadline). The last two 
categories have to do with types of control which the subject might im- 
pose on others as a means of regulating, guiding, or limiting their ac- 
tivities in solving a problem. One such control is to set a deadline on 
work to be done, meetings to be held, or things to be accomplished. 
Merely setting a date for a meeting or the like was not scored; it was 
necessary to mention the specific work to be done and specify that it 
must be done by a certain time. This type of control was observed only 
about once in four in-baskets. 

Imposes Controls: Follow-up or Feedback Planned. This category 
had to do with another type of control in which the subject planned to 
check in some way on the progress made during a course of operations 
being carried out by others. He might plan to check on a certain day, 
for example, or he might ask someone else to check for him. Request- 
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ing an interim or progress report from someone working on an assign- 
ment would also be scored. This control procedure happened even more 
rarely than the preceding one. 


SUMMARY OF DIFFERENCES BETWEEN SCHOOL AND 
BUSINESS IN-BASKET TEST PERFORMANCE 


In Table 13 a number of differences between the school in-baskets 
and the Bureau of Business in-basket are observable. Many of these 
differences are consistent with the common stereotypes of attitudes and 
practices which characterize schools as contrasted with business insti- 
tutions. For example, in the school in-baskets we find greater use of 
human values in problem solving; more instances of courtesy to others; 
a more leisurely approach to problems (more postponing and “plans 
only,” and fewer concluding decisions and terminal actions); more face- 
to-face and telephone communication, and less written communication; 
and fewer instances of social insensitivity. Other differences do not so 
obviously fit the stereotype: In the school in-basket more is written and 
more items are attempted; more careless or minor errors are committed; 
and there is greater tendency to give information to outsiders and sub- 
ordinates and to have discussions with them, but less inclination to be 
informal with subordinates and to explain one’s actions to them. 

It is tempting to attribute such differences to the social norms of 
school and business; but such an interpretation would be risky. In spite 
of the systematic way in which items were chosen to represent the job 
of an elementary school principal (as shown schematically in the para- 
digm in Chapter 4), we do not in fact know to what extent the school 
in-baskets are representative of the job of the elementary school prin- 
cipal. We have much less reason to believe that the Bureau of Business 
in-basket is representative of business. The situation does not even 
involve a business organization, but rather an association of business- 
men. The preparation of the Bureau of Business in-basket was not 
guided by a rationale of the sort used in the school in-baskets; on the 
contrary, it contains many items which were prepared specifically to 
measure certain characteristics such as. social sensitivity. In preparing 
the Bureau of Business in-basket, considerable care was taken to pre- 
sent items with great urgency so that action would be taken in the test 
period rather than deferred. Even the fact that in the Bureau of Business 
in-basket routing slips were provided might easily have influenced the 
style and manner of communication in a variety of ways. 

It must be concluded that differences in means of category scores 


SCORING THE IN-BASKETS Dis 


cannot be attributed to the influences of the cultural expectations about 
behavior in school and business situations. There are too many specific 
influences, both known and unknown, in the in-baskets themselves to 
permit such interpretations. 

The primary reason for including the Bureau of Business in-basket 
was not to provide a basis for comparing administrative behavior in 
school and business, but rather to provide a wider range of adminis- 
trative problems for analysis. It was believed that the patterns of inter- 
relationships would generally be the same for both kinds of in-basket, 
and that the nature of the patterns of behavior would be more easily 
discernible in the intercorrelations among scores which are based on a 
widely varying set of problems. As will be seen in subsequent chapters, 
the search for dimensions of administrative behavior was based on 
scores from all three school in-baskets plus the Bureau of Business in- 
basket. In the later phases of the analysis, the patterns of behavior so 
discovered were used in analyzing the records of behavior obtained 
from the school situation only. 


COURSES OF ACTION 


The type of data obtained pertaining to courses of action is illus- 
trated by Table 14. The item is the same one referred to earlier—Miss 
Blake sends the principal a telegram stating that she is ill and will be 
unable to report for work when school opens. The ten courses of ac- 
tion are listed and the number and percentage of subjects who were 
scored as taking each course of action are shown. The most usual course 
of action was to institute the procedure established by the school system 
for getting a substitute teacher—notify the superintendent’s office; but 
only 80 per cent of the principals took this course of action. Eight of 
the 232 principals used some other procedure for getting a substitute 
which did not involve the superintendent’s office. About an eighth of 
the principals conveyed sympathy and about a fifth referred the prob- 
lem or some aspect of it to Ruth Platz, the Whitman School secretary. 
The total number of courses of action taken was 335, which is about 
one and a half per principal. 

Another problem found in the in-basket is a handwritten note from 
Ed Schramm, the head custodian, stating that when he came to work 
he found the front door unlocked. Nine courses of action were identi- 
fied for this problem. They are shown in Table 15 along with the fre- 
quencies and percentages. 

The most common course of action, taken by 59 per cent of the 
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TABLE 14. Courses of action taken in response to Miss Blake’s telegram 


Per Cent of 
Course of Action Frequency Principals 
Responding 

A. Communicate with superintendent’s office 186 80 
B. Personally initiate procedure for obtaining ~ 

substitute (without involving superin- 

tendent’s office) 8 03 
C. Use (or consider using) Miss Ash as sub- 

stitute 10 04 
D. Provide for instructions and/or help for 

substitute Pan 09 
E. Have substitute attend faculty meeting ity 07 
F. Convey condolence to Miss Blake 29 P 
G. Send Miss Blake (or have sent to her) 

card and/or flowers and/or gift, etc. 1 00 
H. Call Miss Blake’s attention to regulations 

regarding absence v 03 
I. Have records show Miss Blake absent 

from Tuesday faculty meeting + 02 
J. Refer to secretary ay pape 

Total courses of action taken 330 


TABLE 15. Courses of action taken in response to Schramm’s note 


Per Cent of 
Course of Action Frequency Principals 
Responding 
A. Thank Schramm 45 19 
B. Discuss with Schramm aM oe, 
C. Have front door lock checked and/or 
changed 34 15 
D. Make inventory of keys pS) r2 
E. Involve business manager 30 ie 
F. Involve superintendent’s office ib 07 
G. Involve local police 38 16 
H. Notify Schramm of action taken and/or 
plans ZT 12 
I. Clarify responsibility of custodian 9 04 


Total courses of action taken 366 
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principals, was to discuss the problem with Schramm. The next most 
common were to thank Schramm (which probably occurs with B in 
many instances), to involve the police, and to have the lock checked or 
changed. 

It would be possible to describe the responses to each problem in 
this fashion, but little would be gained by doing so. The methods of 
scoring described previously represent various methods of summarizing 
information contained in such tabulations. In later chapters it can be 
seen how well these methods succeeded in producing measures having 
satisfactory psychometric properties and how they were related to other 
variables in the study. 


Chapter 7 


DIMENSIONS OF PERFORMANCE IN 
IN-BASKET WORK 


THE IN-BASKET TESTS CONSTITUTE THE CORE OF THE ADMINISTRATIVE 
tasks in the simulation of Whitman School. The performance of the 
principals on the problems presented by these sets of materials is there- 
fore of central importance to the study and requires comprehensive 
analysis. This chapter is concerned with questions about the scores 
earned by the principals on the 68 categories that were used to describe 
the principals’ responses to in-basket test items with regard to style of 
administrative performance. The focus will be on the quality of these 
scores as performance measures and on their interrelationships. 

The first question to be considered concerns the adding of scores 
assigned to items to obtain a total score for each of the categories. Is 
such a total score for a category analogous to a sum obtained by adding 
apples and oranges together? Might it not be necessary, in order to 
obtain meaningful scores, to add together only a certain selected set of 
the items for one category and other selected sets of items for other 
categories? 

The second question concerns the consistency with which individual 
principals displayed the behavior described by each of the categories. 
Did those principals who, for example, chose to be courteous to subor- 
dinates on some items also tend to be courteous on other items? In 
other words, how reliable are the category scores? 

The third question has to do with the dimensions of performance 
described by the in-basket scores. It may be that the important differ- 
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ences between the principals in their performances on the in-basket tests 
can be described with many less than 68 different measures. The rela- 
tionships between the various category scores will be examined to locate 
the basic types of performance that were covered by the different cate- 
gories. 

The analyses of in-basket test performance reported here are based 
on the three Whitman School In-basket Tests and the Bureau of Busi- 
ness In-basket Test. The decision to combine all four in-basket tests in 
one analysis was based on the assumption that the basic concepts by 
which the performance of principals on these tests can be described will 
not depend on the differences between the two settings. This is not to 
say that the principals are expected to perform in exactly the same man- 
ner in working with the school and business problems, but only that a 
common framework of performance variables can be applied appropri- 
ately to all four tests. The Bureau of Business In-basket Test was in- 
cluded to enlarge the range of problems and thus to make clearer the 
basic dimensions of administrative performance. 


MEANING OF A TOTAL SCORE FOR AN IN-BASKET 
SCORING CATEGORY 


It will be recalled that the response of each principal to each item in 
the in-basket materials was scored for 68 categories of performance 
(Chapter 6). The score for an item usually was in the form of either a 0 
or a 1, O indicating that the category or type of behavior was not present 
in the principal’s response and 1 indicating that it was present. For ex- 
ample, if a principal, in his response to Item 1 of in-basket A, showed 
courtesy to a subordinate (e.g., wrote “Please” or “Thank you’) in 
handling the item, the scorer recorded a 1 for the category Courtesy to 
Subordinates in the appropriate place on her scoring sheet. If the princi- 
pal did not explicitly show courtesy on the item, a 0 was recorded. A 
principal’s score on the category Courtesy to Subordinates was simply 
the total number of 1’s that the eight scorers recorded for him under this 
category. 

Two principals could have earned the same total score on an in- 
basket scoring category by displaying the behavior described by that 
category on completely different sets of items. For example, two princi- 
pals, each of whom earned a score of 35 on Courtesy to Subordinates, 
might have accumulated their scores by choosing to be courteous on 
entirely different sets of 35 items. (In fact, each of the two principals 
might have scores as high as 66 on that category without being courteous 
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on a single item in common.) Since it is possible for two principals to 
earn substantial scores on a category by displaying the performance on 
different items, the possibility exists that two scores of equal value may 
indicate entirely different qualities of performance. Thus, the two princi- 
pals in the example above might have had basically different reasons for 
being courteous to subordinates, and these different reasons could ac- 
count for their selection of the mutually exclusive sets of items upon 
which each earned the score of 35. 

The first step in the analysis of the in-basket test scores was to select 
a small sample of the categories for examination to determine whether 
adding item scores together to obtain a total category score could be 
justified. 

Each of the 68 in-basket scoring categories was studied, and a judg- 
ment was made as to the likelihood that the meaning of a total category 
score might shift if different principals were to respond to different sets of 
the items in earning their scores. Judgments were made by members of 
the research staff who were familiar both with the content of the Scoring 
Manual and with the details of each item included in each in-basket test. 
The criterion for inclusion of a category in this analysis was the likeli- 
hood that it would not be composed of homogeneous items. Six cate- 
gories were selected for study: 


1. Prejudges, Makes Unwarranted Assumption, or 


Largely Inappropriate Perception odd items 
2. Prejudges, Makes Unwarranted Assumption, or 

Largely Inappropriate Perception even items 
3. Initiates a New Structure odd items 
4. Communicates Face to Face odd items 
5. Courtesy to Subordinates even items 
6. Unusual Courses of Action even items 


Because of the extensive computation required, this special analysis 
was limited to 60 of the 132 items. In selecting the 60 items, the entire 


TABLE 16. Values of C* for four selected items and in-basket scoring 
category Initiates a New Structure 


Item A5 A115 A17 A19 
AS .03 01 02 
A15 03 01 03 
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132 items were first divided into groups of 66 odd-numbered and 66 
even-numbered items. Six items were then removed from one of these 
groups at random. If the scoring procedure was found to be justified 
for these categories and groups of items, it was thought that the other 
category scores would also be satisfactory. 

For each of the six groups of categories and items, the within-score 
inter-item covariance (C*) for all pairs of the 60 items was computed 
(a total of 1770 per group).1 A systematic search was made of each of 
the six 60 < 60 matrices of C*’s in an attempt to locate clusters of items 
containing at least six items (10 per cent of the group) within which 
all C*’s were positive and at least +.01 in value. No such cluster was 
found. In fact, the largest cluster of items with C*’s meeting this .01 
criterion contained only four items. Attempts to account for the exist- 
ence of this and other smaller clusters by examination of the content of 
the items were unsuccessful, which suggested that these clusters were 
insignificant insofar as they might affect the meaning of the total category 
scores. 

To illustrate the results of the C* analysis, Table 16 presents the 
values of C* for the clearest cluster of four items that were obtained. 
These four items have C*’s of .01 or larger for the category score Initi- 
ates a New Structure (odd items). 

The four items in this group can be described briefly as follows: 


i 1 n n iy Ty 
C3x* — N- 2z fy ox z a: ae - 
y=0 Y 00 Nisa \iVNEy oe 


where: items j, k = 1,2,...n 


people i= 1,2,...N 


Xi; — item score — 0 or | 
n 
yi = category score = pa, 5, bya IN Pere he 
j= 1 
fy = number of i having given y 
fy, or (fy ) = number of i having given y and xi; = 1 (or xix = 1) 
4; As 
fy = number of i’s having given y and x1jx1x = 1. 


jk 


For a description of C* see Ledyard R. Tucker, “Some Experiments in De- 
veloping a Behaviorally Determined Scale of Vocabulary,” Research Memorandum 
55-10 (Princeton, N.J.: Educational Testing Service, September 1955). Multi- 
lithed report. 
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A5 is a memo from the Assistant Superintendent for Business Manage- 
ment to all principals in the system informing them of a delay in shipment 
of the year’s supply of pencils. 

A15 is a copy of a mimeographed memo to parents from the President 
and the membership chairman of the Whitman School PTA. The memo is 
an invitation to join, participate, and pay the annual dues (a return envelope 
is provided). An attached note from the principal’s secretary says, “Mrs. 
Lackman (the membership chairman) dropped off a supply of these to be 
distributed to each child on opening day.” 

A17 is a note of recommendation from the Superintendent attached to 
a letter from Mildred Ash, an alumna of Whitman School. She indicates that 
she is to be married within a few months but, in the meantime, would like 
part-time employment. 

A19 is a note from the principal’s secretary attached to a copy of the 
previous year’s September “Bulletin to Parents.” The note says, “Mr. Jarrett 
usually sent home bulletins periodically. Attached is a copy of the one sent 
out during the first week of last year.” 


There are many hypotheses that could account for the relationships 
among these four items insofar as they relate to the meaning of Initiates 
a New Structure. First, it could be noted that all four items were from 
in-basket A, but there were many other items in in-basket A that did 
not appear in this cluster. It could be noted also that each of the four 
items posed a problem of first deciding what course of action to take 
before proceeding, but so did most other items not in the group of four. 
Or it could be noted that none of the four items was extremely urgent 
or needed immediate action, but again there were many other items of a 
less pressing nature not among the four. No satisfactory explanation for 
the small relationship among the four items was apparent, and it seemed 
best to regard such clusters as of little or no significance. 

The results of the C* analyses of the five category scores gave no 
reason to reject the procedure of adding item scores to obtain a total 
category score. It was therefore concluded that the meaning of a cate- 
gory score did not change significantly with changes in the particular set 
of items from which it was obtained. 


CONSISTENCY OF PERFORMANCE 


It has been shown that category scores do not require different in- 
terpretations even if they are earned on different sets of items. The re- 
liability of category scores was examined to determine whether those 
principals who showed a large amount of the behavior described by a 
given category on one-half of the items would also show a large amount 
of that behavior on the other half of the items, and, conversely, whether 
those principals who scored low on one-half of the items would also 
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score low on the other items. In other words, were the principals con- 
sistent in their work on the items? This may be viewed as a question of 
the reliability of the in-basket category scores. 

Before computing estimates of the reliability of each category score, 
its distribution was examined. Earlier inspection (see Table 13, Chapter 
6) revealed that some of the categories were scored so infrequently as to 
raise doubts about their having any possible value. For example, a 
response warranting a score in the category Improves Staff occurred 
only 68 times out of a total of more than 30,000 opportunities. Most 
of the principals did nothing in working on their in-baskets that the 
scorers considered as improving their staff. This category was therefore 
eliminated from all further analyses; so were the categories Physical 
Values and Working Conditions, which were scored almost as infre- 
quently. 

Estimates of reliability were made for the remaining 65 categories 
by computing correlations between the odd-numbered items and the 
even-numbered items for each of the categories. These correlations 
were then adjusted to correct for the reduction of one-half in number of 
items (Spearman-Brown correction); the resulting coefficients can be 
interpreted as estimates of the reliability of category scores for the full 
set of 132 items. Table 17 presents these estimated reliabilities of the 65 
category scores. 

The reliability estimates in Table 17 reflect three sources of unre- 
liability. First, the reliability of the score would be attenuated by any 
lack of agreement among the eight scorers as to how the scoring cate- 
gories applied to the responses of the principals. The scoring and quality 
control procedures described in Chapter 6 were designed to reduce this 
source of unreliability as much as was practical, but of course they could 
not eliminate it completely. The second source of unreliability is that 
introduced by inconsistencies in the subjects’ behaviors from item to 
item in the in-baskets. For example, a principal might work for a time 
with the intention of involving his staff in many discussions; but later, 
under the pressure of work, he might forget this intention. Such incon- 
sistencies in performance would lower the reliability of the category 
scores. Third, any general difference between the odd- and even-num- 
bered sets of items would reduce the reliability of the category scores. 

The reliabilities of the 65 category scores shown in Table 17 ranged 
from .00 for the category Informality to Outsiders to .97 for Items 
Omitted. The sizes of these reliability coefficients show a definite rela- 
tionship with the mean scores for the categories (Table 13). Apparently 
the number of times the category was scored is associated with the rela- 
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TABLE 17. Reliability estimates for in-basket scoring categories 


Scoring Category 


Estimated Number of Words 

Number of Items Not Attempted 

Usual Courses of Action 

Rejection of Test Conditions 

Number of Subordinates Involved Individually 

Number of Subordinate Groups Involved 

Number of Superiors Involved 

Number of Outsiders Involved Individually 

Number of Outside Groups Involved 

Unusual Courses of Action 

Gives Recognition for Ability or Good Work 

Shows Awareness of Poor Work 

Carelessness or Minor Error 

Socially Insensitive 

Relates to Background Materials or Other Items 

Conceptual Analysis 

Prejudges, Makes Unwarranted Assumption, or Largely 
Inappropriate Perception 

Uses Human or Personal Values in Analysis 

Uses Physical Values in Analysis 

Uses Program Values in Analysis 

Discusses with Subordinates 

Discusses with Other Principals 

Discusses with Superiors or Outsiders 

Asks for Information, Opinion, Advice, or Permission from 
Subordinates 

Asks for Information, Opinion, Advice, or Permission from 
Superiors 

Asks for Information, Opinion, Advice, or Permission from 
Outsiders 

Requires Further Information 

Delays or Postpones Decision or Temporizes 

Arrives at a Procedure for Deciding 

Contingent Decision 

Concluding Decision 

Makes Tentative or Definite Plans Only 

Work Scheduled for Same or Following Day 

Work Scheduled for Same or Following Week 

Work Scheduled: Indefinite Time or No Time Specified 

Takes Leading Action 

Takes Terminal Action 

Follows Lead by Subordinates 

Follows Lead by Superiors 

Follows Lead by Outsiders 

Follows a Pre-Established Structure 


Reliability 
Estimate 
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TABLE 17, Continued 


Reliability 
Scoring Category Estimate 
Coordination 41 
Initiates a New Structure .78 
Delegates Completely pall 
Delegates Partially with Control 24 
Delegates Partially, but Without Control 39 
Gives Directions and/or Suggestions .83 
Refers to Superiors eli. 
Communicates Face to Face .86 
Communicates by Telephone .74 
Communicates by Writing 90 
Gives Information to Subordinates .66 
Gives Information to Superiors 24 
Gives Information to Outsiders 58 
Explains Actions to Subordinates py: 
Explains Actions to Superiors 19 
Explains Actions to Outsiders 18 
Courtesy to Subordinates 91 
Courtesy to Superiors ys 
Courtesy to Outsiders oe 
Informality to Subordinates Cy 
Informality to Superiors 64 
Informality to Outsiders OO 
Backs Up Teachers or Staff Officers .06 
Improves Staff —* 
Attempts to Improve the Working Conditions of the Staff —* 
Imposes Controls: Sets a Deadline 36 


Imposes Controls: Follow-Up or Feedback Planned .O1 


* Reliability estimates were not computed because of the extremely low fre- 
quency of these scores. 


tive size of the reliability estimates. With one exception (Outside Group 
Involved) no category that was scored on the average for five or more 
of the 132 items had a reliability of less than .50. 

For the purpose of this study, therefore, it was concluded that the 
reliability of the scores for the more frequently used categories was 
satisfactory. 


CHOICE OF METHOD OF FACTOR ANALYSIS 


It was expected that many of the 68 categories utilized in the scoring 
procedure would overlap or measure the same basic type of performance. 
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It seemed likely that much of what was measured by the 68 categories 
could be understood in terms of a much smaller number of underlying 
factors. For reasons of parsimony and efficiency it would be desirable 
to reduce the number of variables to the number of underlying factors. 
A statistical method, factor analysis,” is available by which a matrix of 
intercorrelations may be systematically analyzed and more generally 
described in terms of a reduced matrix of loadings on major factors. 

Forty scoring categories were selected from the entire group of 68 
for use in a factor analysis. The major criterion guiding the selection of 
the 40 category scores for this analysis was the frequency with which 
the categories were used in scoring responses. With one exception, all 
category scores with a mean of less than six were eliminated from this 
analysis. Thus the analysis is based on a major part of the performance 
of the principals as it was scored and, with minor exceptions, the analy- 
sis involved those that were scored most reliably. 

In planning the factor analysis the possibility was considered that 
these correlations might show artificially high relationships because of 
dependencies introduced by the scoring procedure. For example, the 
scoring rules required that a course of action that was scored “1” for 
the category Takes Leading Action be scored “O” for Takes Terminal 
Action. Scoring a course of action in the category Makes Tentative or 
Definite Plans Only precluded scoring several other categories, such as 
Takes Leading Action and Takes Terminal Action. A principal could 
not show Courtesy to Subordinates without involving subordinates either 
as individuals or as a group. Such dependencies, under certain condi- 
tions, could introduce artificial relationships into the intercorrelations. 
These correlations could then be explained in terms of the rules estab- 
lished for scoring rather than in terms of relationships having any basis 
in the performance of the principals. 

The time limit (2 hours and 15 minutes) imposed on the principals 
in their work on each of the in-basket tests might be another factor 
in producing artificial dependencies between category scores. If a princi- 
pal chose to spend a major part of his time on one or two of the more 
complicated items, his performance on the remaining items would ob- 
viously have been affected. 

There are reasons, however, why these possible artificial dependen- 
cies might have little effect on the correlations between category scores: 

* The method of factor analysis is also used extensively in other chapters that 
follow. For a reasonably complete and lucid discussion of the method the reader 
is referred to Raymond B. Cattell, Factor Analysis (New York: Harper & 


Brothers, 1952), p. 464, or L. L. Thurstone, Multiple-Factor Analysis (Chicago: 
University of Chicago Press, 1947), p. 535. 
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First, some items were scored for more than a single course of ac- 
tion. When more than a single course of action was taken in response 
to an item, it was possible for that item to receive scores on categories 
that would otherwise be mutually exclusive. If two courses of action 
were taken, for example, one could be scored for the category Work 
Scheduled for the Same or Following Day and the other for Work Sched- 
uled: Indefinite Time or No Time Specified, but if only a single course 
of action were taken scoring one of these categories precluded scoring 
the other. 

Second, category scores were obtained by summing over the total 
number of items. If these scores did not approach the maximum possible 
score (132 for most categories) an individual could obtain relatively 
large scores for both of two mutually exclusive categories by achieving 
them from different items. Category scores were rarely so large as to 
preclude the earning of large scores on other categories. Thus, for ex- 
ample, the largest observed score, 47, for the category Takes Terminal 
Action, and the largest observed score, 41, for Delays or Postpones 
Decision or Temporizes, two obviously mutually exclusive categories, 
could have been earned by the same principal with a leeway of 44 items. 

The original plan for the factor analysis contemplated using a 
special factor analysis method, the inter-battery method,? as a means of 
reducing the possible influence of any artificial dependencies introduced 
by scoring. With this method the matrix to be factored would contain 
the correlations of the 40 category scores obtained from the odd-num- 
bered items with the same 40 category scores obtained from the even- 
numbered items. This 40 40 matrix is the off-diagonal nonsymmetrical 
submatrix of a larger 80 80 matrix composed of the intercorrelations 
among 80 scores made up of the 40 category scores on odd items and 
the same 40 category scores on even items. The correlations in this off- 
diagonal matrix are between scores assigned by different scorers and 
based on different sets of 66 items. By using these correlations in an 
inter-battery factor analysis, the effects of the differences in how the 
scoring rules were applied by the two sets of scorers and the artificial 
dependencies introduced by the scoring definitions and procedures would 
be reduced. 

The complete 80 80 matrix contains information which permitted 
an examination of the extent to which the correlations between categories 
were actually affected. This complete matrix contains, in addition to the 


*Ledyard R. Tucker, “An inter-battery method of factor analysis,” Psy- 
chometrica, 1958, 23, 111-136. 


Even 


Even 


FIGURE 4. Correlations in off-diagonal matrix plotted against correlations 
in two diagonal matrices for in-basket scoring category Initiates 
a New Structure 
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off-diagonal correlations mentioned above, the intercorrelations among 
the 40 category scores based on even-numbered items and the intercor- 
relations among the 40 scores based on odd-numbered items. 

The effects of a consistent bias in the work of a scorer would be to 
produce in the off-diagonal matrix (odd vs. even items) correlations that 
were smaller than those in either of the diagonal matrices (odd vs. odd, 
and even vs. even items). The dependency effects introduced by scoring 
rules would produce, in the off-diagonal matrix, correlations that might 
be either larger or smaller, depending on the effect of a particular defini- 
tion or scoring rule. As stated earlier, there is reason to believe that these 
effects would be minor. 

An effort was made to determine how large the differences between 
correlations found in the diagonal and off-diagonal matrices were. Tak- 
ing one in-basket scoring category at a time, its correlation with each of 
the remaining 39 in-basket scoring categories in the off-diagonal matrix 
was plotted against its correlation with the same category in each of the 
two diagonal matrices (a total of 78 points was plotted). Figure 4 shows 
a plot of the correlations of the scoring category Initiates a New Structure 
with each of the other 39 categories. Each point plotted with an ‘“‘x” 
is the correlation from the “even vs. even” matrix (on the vertical axis) 
plotted against the corresponding correlation in the off-diagonal matrix 
(on the horizontal axis). Each point plotted with an “o” represents an 
“odd vs. odd” correlation against its corresponding correlation in the 
off-diagonal matrix. 

Figure 4 shows quite clearly that for the category score Initiates a 
New Structure the general size and pattern of its correlations with other 
category scores are not heavily dependent on the specific sample of items 
scored, although there is a slight tendency for the off-diagonal correla- 
tions to be smaller than their corresponding diagonal values (shown by 
the tendency for the x’s to fall above the diagonal line in the figure and 
for the o’s to fall below this line of equal correlation). One pair of the 
points plotted in the figure (indicated by the arrows on the plot) is of 
special interest because they illustrate the effect of a specific scoring rule. 
The points represent the correlations between the categories Discusses 
with Subordinates and Initiates a New Structure. The deviation of these 
points from the line of equal correlations (the diagonal line) is appar- 
ently associated with a scoring rule that specified that Initiates a New 
Structure was to be scored each time Discusses with Subordinates was 
scored (but not vice versa). 

Each of the 40 in-basket scoring categories was examined in a man- 
ner similar to that indicated by the plot of Figure 4. The results sug- 
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TABLE 18.  Intercorrelations among 40 in-basket scoring categories 
Category | PIR MR SO hte) 

1. Number of Words 

2. Items Omitted —67 

3. Usual Action 81 —67 

4. Subordinates Involved 68 —49 67 

5. Subordinate Groups Involved 57-50 67 38 

6. Superiors Involved 48-29 44 35 19 

7. Outsiders Involved 61-42 73 49 43 

8. Unusual Actions 52=—31) 41958043 

9. Aware of Poor Work 39-31 47 34 24 
10. Careless 01 17-15 -—05 —04 
11. Relates to Other Materials 51-24 52 54 31 
12. Conceptual Analysis 34-21 40 29 26 
13. Program Values 23-22 SMILIES 
14. Discusses with Subordinates 55-49 67 52 56 
15. Discusses with Superiors 52-36 61 40 37 
16. Asks Subordinates 53-3 16 bas 2e 41 
17. Requires Information 50-36 57 44 39 
18. Delays —04 —22 -15 -14 -10 
19. Decides on Procedure 64-55 69 60 48 
20. Concluding Decision 2f SOM al eel 
21. Plans Only 10-35 29-14 33 
22. Immediate Work Scheduled 45-41 44 42 36 
23. Intermediate Work Scheduled 35-22 33 39 21 
24. Indefinite Work Scheduled 36-48 55 19 41 
25. Leading Action 60-34 49 71 24 
26. Terminal Action 00 —19 —13 -—02 -13 
27. Follows Subordinates 46-68 53 33 43 
28. Follows Superiors 62-65 65 52 45 
29. Follows Outsiders S0'—34.5051 a3 2G 
30. Follows Structure 40-41 32 60 25 
31. Initiates Structure 66-53 77 69 59 
32. Directs 66-4355) aon} 
33. Communicates Face to Face 62-58 75 55 59 
34. Communicates by Telephone 40-35 50 25 37 
35. Communicates by Writing 57-45 43 67 21 
36. Informs Subordinates 60-37 S55 53 48 
37. Informs Outsiders 4320647 6232.29 
38. Courtesy to Subordinates 36-10 23 50 13 
39. Courtesy to Outsiders 41-14 31 18 20 
40. Informality to Subordinates 32-30 34 45 10 


12-22 33 01-02 24 


gested that little would be gained by basing the factor analysis on the 
off-diagonal matrix of correlations between “odd” and “even” scores. 
It was decided to ignore the apparently minor effects of forced depend- 
ency among categories and to use the more reliable scores obtained from 
all items, odd and even. The matrix of intercorrelations among the total 
(odd and even items combined) category scores was then computed for 
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use in a regular factor analysis rather than an inter-battery analysis. The 
results of the analysis should accordingly be more stable and dependable. 

Table 18 presents the intercorrelations among the total category 
scores for the 40 categories (decimal points are omitted; means and 
standard deviations have been presented in Table 13). These are the 
correlations used in the factor analysis. 
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FACTOR ANALYSIS 


The correlations between the category scores range from a high 
value of .89 between Discusses with Subordinates and Communicates 
Face to Face to a negative value of —-.68 between Items Omitted and 
Follows Subordinates. The category score for Items Omitted is nega- 
tively related to all the other categories except Careless. Terminal Ac- 
tion also shows a general negative relationship to all other categories 
with the very noticeable exception of Concluding Decision with which 
it correlates .78. Table 18 shows a pattern of complex relationships 
between category scores which can best be described by the results of the 
factor analysis. 

The factor analysis proceeded in a straightforward manner. First, 
the communality of each category score was estimated as equal to its 
largest correlation with another category score. Characteristic roots 
and vectors of the matrix of intercorrelation were then obtained. (Com- 
puting was done with the aid of a high-speed computer.) Table 19 
lists in order of size the 12 positive roots that exceed the absolute value 
of the largest negative root (—.35). Inspection of the order and size of 
the roots suggested either five or eight factors. A noticeable, although 
small, change in the rate of decrease of size of roots can be seen at both 
these points. Eight factors were retained, since it appeared more de- 


TABLE 19. Characteristic roots exceeding value of largest negative root 


Order Roots Decrease 
I 13.16 

II 4.20 8.96 
II S010 1210 
IV els 1432 
V 1226 oe 
VI ASP 31 
Vil 83 12 
Vill ait: 10 
IX 58 13 
»4 51 07 
XI .46 OS 
XII 36 10 
XL —.35 (largest negative root) 


Total 26.34 
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sirable to work with an excess of factors than with too few. Factor 
loadings on eight factors were computed for each of the 40 category 
scores. The resulting orthogonal factor matrix is presented in Table 20, 
and a distribution of the residual correlations is given in Table 21. 

The large majority (91 per cent) of the residual correlations are 
within the range of +.05. Thus, eight factors account for most of the 
common variance in scores on the 40 categories. A comparison of the 
communality (h? in Table 20) of each category score with the estimate 
of its reliability (Table 16) suggested that the eight factors also account 
for all the reliably measured variance of most of the categories. Notable 
exceptions are the categories Careless, Delays, Courtesy to Subordinates, 
and Informality to Subordinates, which have substantial variance that 
cannot be attributed to unreliability and that is not shared by other cate- 
gories. Excepting these categories, and excepting the possibility that one 
or more of the 25 categories not included in the analysis might introduce 
other factors, it appears that eight factors are all that are needed to ac- 
count for performance on the in-basket tests. 

A rotation was made of the orthogonal factor matrix to obtain an 
oblique factor matrix showing simple structure. The transformation 
matrix desired was determined by the application of graphic methods. 
Table 22 presents the transformation matrix and Table 23 the resulting 
oblique factor matrix. (Table 23 also contains loadings for second-order 
factors, to be discussed later.) 


FIRST-ORDER FACTORS 


Only a tentative interpretation of the eight first-order factors will be 
made at this time. Later (in Chapters 12 and 13) the relationships be- 
tween each factor and many other variables will be examined. These re- 
lationships will do much to illuminate the nature of the factors. 

Factor A has loadings of +.25 or higher for the following six in-bas- 
Ket category scores: 


16. Asks for Information, Opinion, Advice, or Permission 


from Subordinates 50 

36. Gives Information to Subordinates 45 
17. Requires Further Information 34 
37. Gives Information to Outsiders 31 
5. Number of Subordinate Groups Involved 2° 
3. Usual Courses of Action 25 


This factor quite clearly relates to the exchange of information (ask- 
ing for information, giving information, and noting that information is 
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TABLE 21. Distribution of residual correlations 


Value of 
Residuals Frequency 
Alto — 3 
[09 TOM LU 1 
10 7tOnee 0S 8 
(Wey itey Sie by 
03 to .04 1 
0} Ee Kon 092 161 
.O0to .d00— 226 
—.01 to —.02 161 
—.03 to —.04 86 
—.05 to —.06 24 
—.07 to —.08 12 
—.09 to —.10 3 
—llto — 3 
Total 780 


required). The exchange does not appear to be oriented exclusively to- 
ward any particular class of associates, such as subordinates. The factor 
has been named Exchanging Information. 

Factor B has loadings of +.25 and above on the following 14 cate- 
gory scores: 


24. Work Scheduled: Indefinite Time or No Time Specified .63 


14. Discusses with Subordinates .62 
33. Communicates Face to Face .60 
31. Initiates a New Structure 48 
19. Arrives at a Procedure for Deciding .46 
21. Makes Tentative or Definite Plans Only .40 
15. Discusses with Superiors or Outsiders 39 

3. Usual Courses of Action 36 
17. Requires Further Information oe 

5. Number of Subordinate Groups Involved Pe 
27. Follows Lead by Subordinates ao 
28. Follows Lead by Superiors 29 
26. Takes Terminal Action —.25 

2. Number of Items Not Attempted —.40 


This factor appears to be related to making definite plans for face- 
to-face discussions with the appropriate persons before taking final ac- 
tion on a problem. It may represent one of the most frequently used 
ways of clarifying problems and preparing for their solution. The work 
scheduled (Category 24) is likely to involve a plan for an informal 
meeting or discussion as a procedure for deciding (Category 19). Ac- 
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TABLE 22. Final transformation matrix 


A B C D E ie G H 
I 18 34 ped | .06 15 06 O5 12 
II 03 36 —.46 02 —.07 00 —.06 —.50 
Il 03 30 44 O1 10 —.16 20 —.53 
IV 13 —12 —.50 yl 26 —.28 aL 07 
Vv 06 03 —51 —.73 56 01 47 11 
VI —.33 —18 —.01 22 —.04 iti 3 .03 
VII abs) 43 00 —22 —75 —.40 9 45 


VII —.90 65 —.15 .20 15  —37 —.13 49 


tual face-to-face discussions are not immediately available to the princi- 
pals as responses to the in-basket items, and must therefore be reported 
as plans in their written responses to the material. This factor has been 
entitled Discussing with Others before Acting (Discussing before Act- 
ing). 

Factor C has loadings in excess of +.25 for 14 category scores as 
follows: 


20. Concluding Decision IG, 
27. Follows Lead by Subordinates 65 
26. Takes Terminal Action aes) 
28. Follows Lead by Superiors 50 
30. Follows a Pre-established Structure .48 
35. Communicates by Writing 45 
1. Estimated Number of Words ‘33 
4. Number of Subordinates Involved Individually 1 
32. Gives Directions and/or Suggestions soul 
36. Gives Information to Subordinates 28 
3. Usual Courses of Action 2 
40. Informality to Subordinates all 
5. Number of Subordinate Groups Involved 26 
2. Number of Items Not Attempted —.68 


There appear to be three closely interrelated facets to Factor C: (1) 
making final decisions, (2) complying with suggestions made by others, 
and (3) taking terminal action. It should be noted that omitting an 
item (Category 2) can be a type of noncompliance. It is interesting 
also that decisions and actions taken on in-basket materials tend to be 
communicated by writing. This again may be a reflection of the restric- 
tions on responses which are inherent in in-basket tests. This factor is 
called Complying with Suggestions Made by Others (Complying with 
Suggestions ). 
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There are only three category scores with loadings above +.25 for 
Factor D: 


13. Uses Program Values in Analysis .82 
12. Conceptual Analysis ie 
9. Shows Awareness of Poor Work 28 


This factor relates to the broad “situational” analysis of the prob- 
lems presented by the in-basket items. The long-range and more subtle 
ramifications of the items have been considered. One of the more fre- 
quently expressed program values was concern for public or community 
relations, which usually was scored also for Conceptual Analysis since 
“public relations” often represented a ramification of the problem pre- 
sented by the specific item. Factor D has been labeled Analyzing the 
Situation. 

Factor E has loadings for seven categories above +.25 as follows: 


6. Number of Superiors Involved 54 
15. Discusses with Superiors or Outsiders 42 

7. Number of Outsiders Involved Individually 41 
11. Relates to Background Materials or to Other Items OH, 
29. Follows Lead by Outsiders 26 
34. Communicates by Telephone .26 
18. Delays or Postpones Decision, or Temporizes —.38 


This factor quite clearly involves the principal’s relationships both 
with his superiors and with outsiders. It is not so clear as to the content 
of the superiors’ involvements. There is a suggestion in the negative 
loading on the category Delays or Postpones Decision, or Temporizes 
and in the positive loadings on Relates to Background Materials and 
Communicates by Telephone that the content is regarded by the princi- 
pals as important. For reasons that will become much clearer when evi- 
dence presented in later chapters is examined, the label Maintaining Or- 
ganizational Relationships (Maintaining Relationships) was selected for 
this factor. 

Factor F has loadings that meet the criterion of +.25 or larger for 
these five category scores: 


23. Work Scheduled for Same or Following Week it 
22. Work Scheduled for Same or Following Day 50 
30. Follows a Pre-established Structure 30 
11. Relates to Background Materials or to Other Items Pal 


24. Work Scheduled: Indefinite Time or No Time Specified —.48 


This factor appears to be related to an orderly, organized approach 
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to work, at least as far as the scheduling of work is concerned. It has 
been called Organizing Work. 

Factor G has loadings of +.25 or larger for each of the following 
six category scores: 


37. Gives Information to Outsiders 44 
39. Courtesy to Outsiders 44 
29. Follows Lead by Outsiders 41 
7. Number of Outsiders Involved Individually 1 
10. Carelessness or Minor Error .30 
9. Shows Awareness of Poor Work —.31 


There is a clear indication of responsiveness to outsiders appearing 
in this factor. The negative loading on Shows Awareness of Poor Work, 
which usually involves the work of subordinates, suggests that this factor 
refers to a general outside rather than inside orientation to problems. 
The positive loading on Carelessness or Minor Error further supports 
the viewpoint that this factor may be “responsiveness” without critical 
reflection. This factor has the title Responding to Outsiders. 

Factor H has loadings of +.25 or larger for nine of the category 
scores: 


25. Takes Leading Action .64 
35. Communicates by Writing 9 
38. Courtesy to Subordinates 7. 
32. Gives Directions and/or Suggestions 47 
39. Courtesy to Outsiders .40 
10. Carelessness or Minor Error ei! 

4. Number of Subordinates Involved Individually 28 
34. Communicates by Telephone —.30 
21. Makes Tentative or Definite Plans Only —.67 


This factor relates to directing the work of others toward solutions 
of problems and certainly goes beyond planning. It is interesting to note 
that showing courtesy loads on this factor and that writing rather than 
telephoning is the preferred means of communication. This factor was 
given the name Directing the Work of Others (Directing Others). 

The interpretations of the eight factors have been restricted to their 
more general or obvious features. Their full meaning will become clearer 
as their relationships with the other variables of the study are examined. 


SECOND-ORDER FACTORS 


The eight factors (A through H) are not entirely independent of one 
another. Table 24 presents the intercorrelations among these eight fac- 
tors. 


144 ADMINISTRATIVE PERFORMANCE AND PERSONALITY 


TABLE 24. Intercorrelations among first-order factors 


Factor Jes B C D E F G H 
A 1.00 65 —.15 Onl Jae) 53 —.38 Rey | 
B 65 100 —.19 26 pays 710 —.39 36 
iC: —15 —.19 100 —.02 33 —.28 “oD .0O 
D 7. 26 —.02 1.00 .20 tL .03 PA! 
E 29 pays O05) PA AO .04 .07 29 
F Pe 70 —.28 ih) .04 100 —.44 44 
G —.38 hy 35 03 O07 —.44 1.00 —.36 
H oot) 36 .0O 21 Dak 44 —.36 1.00 


The largest positive correlation is between Factors B and F (.70). 
This correlation reflects the fact that planned face-to-face discussions 
offer opportunity to schedule work for the future (perhaps require it). 
The positive correlation (.65) between Exchanging Information (Factor 
A) and Discussing with Others (Factor B) demonstrates that they have 
in common a general process of communication. Responding to Out- 
siders (Factor G) and Complying with Suggestions (Factor C) tend to 
go together (r = .35) and to show negative relationships with most 
other factors (A, B, F, and H). 

The intercorrelations between the oblique factors presented in Table 
24 were themselves factored to examine the possibility of meaningful 
second-order factors. Characteristic roots and vectors and the orthogo- 
nal factor matrix were computed after a preliminary analysis. The 
largest correlation with another factor was used as an estimate of com- 
munality in the preliminary study, but in the final study these estimates 
were based on the communality determined in the preliminary analysis. 
(The results of the preliminary analyses were similar to those of the final 
analyses and are not reported.) Inspection of the size of the character- 
istic roots suggested that we retain two factors. The unrotated and ro- 
tated* orthogonal factor matrices are given in Table 25, and Table 26 
shows the residual correlations. 

The diagonal values in the table of residual correlations show the 
part of the total variance of each factor which is not shared with the 


* Rotation of second-order factors can seldom be done with the same degree 
of confidence as is customary in rotating primary factors. Factor structures 
may be less than compelling. The reasonableness of the rotations reported here 
is demonstrated by the interpretations of the second-order factors. However, at 
least one other rotation is possible which can be interpreted. The interested 
reader may wish to consider the results of this second rotation which is reported 
in Appendix F. 
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TABLE 25. Second-order orthogonal factor matrices 


Oblique Unrotated Rotated ne 

Factor x Y SG Y 
1. Factor A 83 19 .66 54 ans 
2. Factor B 19 —.01 Al 34 .62 
3. Factor C —.25 ae) —.47 38 oul 
4. Factor D 2 fae aL 36 16 
5. Factor E 23 9 —.05 .63 .40 
6. Factor F ey —.21 .78 m6 .63 
7. Factor G —.53 35 —.63 .08 .40 
8. Factor H 61 20) 46 45 41 


two second-order factors and can be regarded as the unique content of 
the factor. Thus, Factor D is most nearly independent of the second- 
order factors, while Factor A has but a small part of its variance which 
is not also included in one or other of the two second-order factors. 

The saturation of each scoring category with the two second-order 
factors was determined and used in interpreting the second-order factors. 
These saturations are listed as columns X and Y of Table 23. Factor X 
has loadings of +.25 or above for Factor A, Exchanging Information; 
B, Discussing with Others before Acting; F, Organizing Work; and H, 
Directing the Work of Others; and substantial negative loadings for G, 
Responding to Outsiders, and C, Complying with Suggestions Made by 
Others. The following categories are saturated +.50 with Factor X: 


19. Arrives at a Procedure for Deciding .69 
17. Requires Further Information .64 
22. Work Scheduled for Same or Following Day .61 
14. Discusses with Subordinates .60 


TABLE 26. Oblique factor residual correlation matrix 


Oblique 

Factor 1 2, 3 4 5 6 i 8 
1. Factor A 2h 00 —.05 06 —.01 —.07 —.01 .03 
2. Factor B .0O 38 01 .02 04 .09 .03 —.12 
3. FactorC —.05 01 63 —.08 .06 .03 .02 .04 
4. Factor D .06 .02 —.08 84 —.02 —.02 11 —.03 
5. FactorE —.01 .04 .06 —.02 60 —.01 —.02 .03 
6. Factor F —.07 .09 .03 —.02 —.01 ro7. .03 .02 
7. FactorG —.01 .03 .02 11 —.02 .03 60 —.11 
8. Factor H 03 —.12 .04 —.03 .03 02 —.11 9 
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16. Asks for Information, Opinion, Advice, or Permission 


from Subordinates 56 
33. Communicates Face to Face ao 
31. Initiates a New Structure 54 
23. Work Scheduled for Same or Following Week 54 
20. Concluding Decision —.52 
26. Takes Terminal Action —.62 


This factor is bipolar, with negative loadings on Factors G and C 
and on category scores Concluding Decisions and Takes Terminal Ac- 
tion. It has positive loadings on factors and categories indicating discus- 
sion, getting information, and scheduling work for the future. This factor 
clearly reflects preparation for making decisions before taking action vs. 
immediately responding with a final decision or terminal action. Factor 
X was entitled Preparation for Decision vs. Taking Final Action (Prep- 
aration for Decision). 

Factor Y has loadings of +.25 on all factors except F, Organizing ~ 
Work, and G, Responding to Outsiders. The following nine categories 
are saturated +.50 with Factor Y: 


1. Estimated Number of Words Of 
3. Usual Courses of Action 65 
7. Number of Outsiders Involved Individually .60 
32. Gives Directions and/or Suggestions i, 
4. Number of Subordinates Involved Individually oo Wd 
35. Communicates by Writing 56 
25. Takes Leading Action pe 
36. Gives Information to Subordinates sie 
28. Follows Lead by Superiors cL 


This factor has small negative loadings on the categories Items Not 
Attempted (—.43), Delays, or Postpones Decision, or Temporizes 
(—.26), and Makes Tentative or Definite Plans Only (—.08). It ap- 
pears to be an over-all output of work or productivity factor. It sat- 
urates 33 of the 40 category scores to the extent of +.25 and has been 
labeled Amount of Work Expended in Handling the Item (Amount of 
Work). 

At the level of abstraction represented by the second-order factors, 
the administrative performance of the principals in the in-basket test 
situation can be described by reference to (1) the amount of preparation 
that is planned or contemplated as preliminary to making final decisions 
and taking terminal actions, and (2) the amount of work that is ex- 
pended in the process of handling the items. A more complete picture is 
provided if there is added eight first-order factors covering (a) exchang- 
ing information, (b) discussing problems with others before acting, (c) 
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complying with suggestions made by others, (d) making analyses of the 
situations, (e€) maintaining organizational relationships, (f) organizing 
work, (g) responding to outsiders, and (h) directing the work of others. 
In the chapters to follow, both levels of description will be considered. 


In this chapter, the complex record of the principal’s performance 
on the in-basket test has been studied. The properties of the scoring 
categories have been examined. First, the assumptions involved in add- 
ing across items to obtain total scores for a category were questioned. 
It was shown that such scores are not made ambiguous by shifts in 
meanings associated with the set of items from which they are earned. 
Category scores were found to be reliable in that they reflect consistent 
individual differences in performance. A factor analysis of the intercor- 
relations between 40 of the most frequently used categories resulted in the 
finding of eight first-order and two second-order factors. These factors 
are interpreted as basic concepts of administrative performance in the 
in-basket test situations. 


Chapter 8 


THE CONTENT SCORES OF 
THE IN-BASKET TEST 


THE METHOD DEVELOPED FOR OBTAINING SCORES BASED ON CONTENT 
rather than on style of the principals’ responses to in-basket problems 
was described in Chapter 6. To review briefly: The Score Sheet pro- 
vided a place for recording up to 10 courses of action which a principal 
might take in his response to each in-basket problem. Courses of ac- 
tion were stated in such terms as “refer to secretary,” “make inventory 
of pencils,” or ‘‘clarify responsibility of custodian.” Certain of these 
courses of action were chosen to form scoring keys for content score 
categories. One content score, the Imaginative score, included courses 
of action judged to be “good ideas” which went beyond actions 
immediately suggested by the stimulus materials—actions which to 
some degree were creative or imaginative solutions to the problem. 
“Make inventory of pencils” was keyed for the Imaginative score be- 
cause it is an action which was not suggested by anything in the stim- 
ulus materials; it is a good idea which the principal thought of himself. 
A second content score, the Organizational Change score, included in its 
key all courses of action judged to involve changing the organization— 
by changing personnel, duties, or practices. For example, “clarify re- 
sponsibility of custodian” was keyed for Organizational Change. The 
content score for the Imaginative content score is the number of courses 
of action taken by a principal which were keyed as imaginative; simi- 
larly, the Organizational Change score is the number of courses of ac- 
tion taken which were keyed for organizational change. 
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Most of the methods of scoring in-basket responses have empha- 
sized description rather than evaluation. The Imaginative content score 
is an exception; it contains a definite element of evaluation of the prin- 
cipal’s behavior. Only those courses of action that were judged to be 
good ideas were keyed for imaginativeness. An idea which might be 
unusual or clever was not keyed unless it was also a good solution to 
the problem posed by the item. The Imaginative content score is thus 
the number of good ideas generated by the principal. Imaginativeness 
will be of special interest insofar as it implies an evaluation of the qual- 
ity of a principal’s in-basket behavior which is based solely on the 
content of his action. 

This chapter is concerned primarily with the relationships of the 
two content scores to other measures obtained in the study. But first 
some characteristics of the content scores themselves will be discussed. 


RELIABILITY OF CONTENT SCORES 


The reliability of the content scores is reported in Table 27. The 
odd-even reliability coefficients are based on correlations between odd- 
and even-numbered in-basket items, except that there was some rearrange- 
ment of items to produce half-tests which were more nearly equal with 
respect to number of items, i1.e., number of courses of action keyed for 
the content score. The correlations are of course corrected for double 
length. Kuder-Richardson formula #21 was used to give estimates of 
reliability which are independent of any particular division of problems 
into half-tests. 

Both scores are reliable enough for use in correlational analysis. 
For the Imaginative score, the Kuder-Richardson reliabilities and odd- 


TABLE 27. Means, standard deviations, and reliability of content scores 


Maximum Reliability 
Score Possible Mean S.D. ODD- K-R 
Score EVEN #21* 
Imaginative 
All in-baskets 170 13.26 5.90 .68 .70 
BB in-basket 83 4.65 2.95 58 D1 
Organizational Change 
All in-baskets 70 5.88 2.92 61 .48 
BB in-basket 42 2.96 2.18 .63 5 


* Kuder-Richardson formula #21. 
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even reliabilities are essentially the same; but for Organizational Change 
the Kuder-Richardson formula gives lower reliabilities, presumably be- 
cause of lack of homogeneity of the items. Reliability of the Organiza- 
tional Change score is lower than for Imaginative, no doubt because it 
is a much “shorter” test (70 as compared with 170 items, in the case of 
all in-baskets combined). In the case of the Imaginative score, the 
Bureau of Business in-basket is somewhat less reliable than all four in- 
baskets combined, as might be expected on the basis of test length. The 
reliability of Organizational Change is greater for the Bureau of Business 
alone than for all four in-baskets; apparently the Bureau of Business 
problems provide a more homogeneous set of opportunities for this 
kind of behavior to be exhibited. 

The differences in means reflect the number of courses of action 
keyed for each score. Comparison with the maximum score possible 
shows that in general the courses of action keyed for both Imaginative 
and Organizational Change occur quite rarely. The Bureau of Business 
in-basket contributes to both content scores to an extent which is out of 
proportion to the number of items it contains. 

The correlation between the imaginative score and Organizational 
Change score is .53. Since 56 per cent of the organizational change 
items were also keyed for imaginative score, a high correlation between 
them is to be expected. 


CORRELATIONS OF CONTENT SCORES WITH OTHER 
CHARACTERISTICS OF PRINCIPALS 


In this section, the correlations of the two content scores with other 
measures obtained from the 232 principals will be presented. The con- 
tent scores are based on all four in-baskets. A correlation of .17 is 
significant at the .01 level; in the following discussion attention is 
focused on variables having correlations of +.20 or higher with con- 
tent scores. 


TABLE 28. Correlations of two content scores with biographical information 


Organizational 
Imaginative Change 
Age .O1 —.11 
Years in Professional Work .08 —.11 
Years in Administration AUT —.06 


Years of Academic Preparation .06 —.02 
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WITH BIOGRAPHICAL DATA 

The correlations of content scores with biographical information, 
shown in Table 28, are all very low and mostly nonsignificant. Appar- 
ently there is no consistent tendency for imaginativeness or tendency to 
produce organizational changes to be related to age, experience, or 
years of academic preparation. 


WITH BASIC MENTAL ABILITY AND PROFESSIONAL AND 

GENERAL KNOWLEDGE SCORES 

There is a marked tendency for the content scores to correlate with 
a variety of cognitive measures, as is shown in Table 29. In the case 
of the Imaginative score, all the correlations shown are significant. The 
best of the basic ability tests insofar as relating to imaginativeness may 


TABLE 29. Correlations of two content scores with basic mental abilities, 
professional and general knowledge, and background achieve- 


ment 
Organizational 
Imaginative Change 
Basic Mental A bilities 
Deductive Reasoning 30 27 
Speed of Closure 1 32 14 
Number Facility 1 35 aly, 
Verbal Knowledge 46 saul 
Inductive Reasoning 34 AA 
Associative Memory 1 Sigs .O9 
Number Facility 2 iP) bale 
Flexibility of Closure a) 30 
Associative Memory 2 J) 18 
General Reasoning t2) yea 
Visualization so ii 
Speed of Closure 2 Ps) .20 
Word Fluency .40 19 
Expressional Fluency 26 18 
Ideational Fluency 38 oD 
Associational Fluency Be .26 
Professional and General Knowledge 
School Administration and Supervision Aah 42 
Education in the Elementary School .63 41 
NTE Social Studies, Literature, and Arts 56 .46 
NTE Science and Mathematics asd 2 


Background Achievement 
Total Score | .46 45 
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be concerned are the fluency (r — .40, .26, .38, and .39) and verbal 
knowledge tests (r = .46); but both number facility tests and the flex- 
ibility of closure test have correlations of .35 with imaginativeness. 
Reasoning tests (r= .30, .34, and .27) and speed of closure tests 
(r = .32 and .25) are next highest, and memory tests have low cor- 
relations (r — .17 and .25). These relationships appear to be consistent 
with the notion that the Imaginative score does reflect a certain amount 
of “goodness” in problem solving. 

The most striking findings, however, are the high correlations with 
the tests of professional knowledge (r = .65 and-.63). The correlation 
of .65 with the School Administration and Supervision Test is almost 
as high as the reliability of the Imaginative score. If reliabilities are 
.70 and .90 for the two measures, and a correction for attenuation is 
made, the correlation between perfectly reliable measures is found to 
bens 2: 

The Social Studies Test also has a fairly high correlation with imag- 
inativeness (r = .56), but the Science and Mathematics Test does not 
(r= .31). The test covering the background materials of the study 
correlates .46 with imaginativeness. 

Organizational change has a somewhat different pattern of correla- 
tions with the basic mental abilities. The highest correlations are those 
with visualization, verbal knowledge, general reasoning, and flexibility 
of closure. The correlations are generally lower, as would be expected 
in view of the lower reliability of the Organizational Change score. The 
most strongly related tests are of Professional and General Knowledge 
and the achievement test. The general knowledge and achievement 
tests are relatively more related to organizational change than imagina- 
tiveness. 

These correlations can no doubt be attributed partly to a general 
tendency for bright people to be more productive—to write more, at- 
tempt more items, and take more courses of action. Taking more 
courses of action would of course tend to be associated with higher 
scores on both content categories. 


WITH INTEREST MEASURES 


The correlations of content scores with Strong Vocational Interest 
Blank for Men scores appear in Table 30. Organizational Change cor- 
relates significantly with none of the interest measures. But there are 
some interesting relationships with the Imaginative score, as shown in 
the first column of the table. 

The highest correlation in the Imaginative column is .32 for the 
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TABLE 30. Correlations of two content scores with Strong Vocational In- 
terest Blank for Men scores 


Organizational 
Imaginative Change 
Psychologist 232 2 
Physician sls .02 
Engineer —.05 .03 
Production Manager —.22 .00 
Mathematics-Science Teacher —.18 —.03 
Policeman —.29 —.04 
Personnel Manager .09 S12; 
Public Administrator 10 14 
Social Science Teacher —.02 O01 
City School Superintendent 215 .08 
Minister ely .03 
Accountant —.24 —.13 
Purchasing Agent —.18 —.09 
Sales Manager .04 .O1 
Lawyer 24 = lel 
President Manufacturing Concern —.02 —.04 
Masculinity-Femininity —.14 —.01 
Occupational Level oA .08 


psychologist key of the Strong Vocational Interest Blank for Men. 
There is clearly a tendency for those principals who most resemble 
psychologists in their responses to this blank to take more of the courses 
of action which we have designated as imaginative. 

Those principals earning high imaginative scores also tend to 
resemble lawyers (r = .24) and those in jobs at a high occupational 
level (r = .21). Their interests tend to be unlike those of policemen 
(r = —.29), accountants (r = —.24), and production managers (r = 
—.22). 


WITH PERSONALITY INVENTORY SCORES 


Correlations of content scores with scores on the basic personality 
factors are shown in Table 31. Again there are no significant correla- 
tions with Organizational Change, and there are only two significant 
correlations with the Imaginative score. Principals who take imagina- 
tive courses of action are those who tend to be somewhat nonconven- 
tional (character strength vs. lack of conventional standards, r= 
—.23). There is also a slight tendency for imaginativeness to be 
associated with emotional sensitivity rather than tough-mindedness 
ie —.21); 
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TABLE 31. Correlations of two content scores with basic personality factors 


Organizational 
Imaginative Change 
A. Friendly —.02 —.06 
C. Emotional Stability aS .08 
E. Dominance .O1 05 
F. Enthusiastic 06 .06 
G. Character Strength —.23 —.15 
H. Adventurous 020 —.01 
I. Emotionally Sensitive oil 10 
L. Suspicious —.16 —.05 
M. Nonconventional 14 .04 
N. Sophistication —.13 —.05 
O. Insecurity —.10 —.05 
Q,. Radicalism —.01 —.06 
Q,. Self-sufficiency .O9 09 
Q,. Will Control —.11 —.14 
Q,. Nervous Tension .00 .0O0 


WITH IN-BASKET CATEGORY SCORES 


The correlations of content scores with a selected set of 32 in-basket 
category scores are shown in Table 32. Since both style and content 
scores were obtained from the same materials, there is some experi- 
mental dependence among these measures; one may therefore expect 
to find spuriously high correlations between the content scores and 
some of the category scores. This is true, even though the scores on 
in-basket categories were based on examination of the actual responses 
produced by the principals, while the content scores were based on the 
classification of the responses according to course of action taken. 

Both the Imaginative and Organizational Change scores have a 
fairly high correlation with amount written (.56 and .47 respectively). 
The other high correlations in the Imaginative column are with Asks 
Subordinates (r = .61), Decides on Procedure (r = .54), Communi- 
cates Face to Face (r = .52), Relates to Other Materials (r = .49), 
and Discusses with Subordinates (r = .47). The imaginative principals, 
according to this content score, seem to be characterized by prepara- 
tion for decision through consultation and collection of information, 
rather than by acting precipitately. The correlations with Concluding 
Decision and Terminal Action are negative (r = —.06 and —.30). 

The high correlations with categories like Asks Subordinates fol- 
lows from the kinds of courses of action which were selected as imag- 
inative: About 40 of the 170 courses of action keyed for this content 
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TABLE 32. Correlations of two content scores with in-basket category scores 


Organizational 
Imaginative Change 
Asks Subordinates 61 34 
Informs Subordinates 45 29 
Discusses with Subordinates 47 ian 
Communicates Face to Face sey 30 
Decides on Procedure 54 oT 
Concluding Decision —.06 230 
Follows Subordinates 18 38 
Terminal Action —.30 .08 
Program Values JAS 23 
Conceptual Analysis .46 ol 
Superiors Involved 21 Doe 
Discusses with Superiors 45 24 
Outsiders Involved 47 fp 
Relates to Other Materials 49 24 
Immediate Work Scheduled 29 13 
Intermediate Work Scheduled 29 10 
Informs Outsiders 29 34 
Follows Outsiders .20 29 
Courtesy to Outsiders 19 ml 
Leading Action ae) 18 
Courtesy to Subordinates ez) 05 
Directs 45 30 
Careless —.19 —.07 
Delays —.07 —.11 
Informality to Subordinates pH) 23 
Number of Words 56 47 
Recognition for Good Work 42 28 
Prejudges —.10 —.01 
Human Values 34 19 
Controlled Delegation —.07 —.08 
Uncontrolled Delegation —.07 —.11 
Sets Deadline 17 .O9 


score appear to involve the exchange of information. The correlation 
can be viewed as merely the result of this emphasis in keying; but the 
fact remains that the keying of the courses of action was a separate op- 
eration, and the correlation is the reflection of the judgments made in 
the process of keying. 

In contrast with the findings for imaginativeness, the correlations 
involving organizational change are lower and the pattern is different. 
Positive instead of negative correlations are found with Terminal Action 
and Concluding Decision (r = .08 and .30). The correlations in the 
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Organizational Change column are higher for several other variables: 
Follows Subordinates (r = .38), Follows Outsiders (r = .29), Courtesy 
to Outsiders (r = .21), Informs Outsiders (r = .34), and Superiors 
Involved (r = .23). These findings suggest that principals who score 
high on Organizational Change tend to make final decisions and to be 
sensitive to the needs and wishes of others. In common with the imag- 
inative principals, they also tend to ask subordinates for advice and to 
involve many outsiders. 


WITH GROUP INTERACTION CATEGORIES 


Table 33 presents correlations of content scores with the measures 
based on the group interaction problem. The first five variables are 
based on records made by observers of the group members and the sec- 
ond five on ratings made by the participants at the conclusion of the 
problem. 

There are several significant correlations involving the Imaginative 
score. Imaginative principals tend to suggest procedures (r = .24) 
and ask for information (r = .22), and they tend to be judged as effec- 
tive in presenting facts (r = .24). They also are inclined to talk a lot 
(r= .21). One might expect imaginative principals to “raise new is- 
sues,” but the correlation is found to be zero. 

None of the correlations with Organizational Change reaches .20, 
although several correlations are statistically significant. 


WITH EDUCATIONAL CONCERNS 
The Imaginative score correlates significantly with most of the 12 
categories of instructional awareness and the six categories of job per- 


TABLE 33. Correlations of two content scores with group interaction cate- 


gories 
Organizationai 
Imaginative Change 
Frequency of Interaction 53) 213 
Gives Positive Information — 18 .08 
Asks for Information ye he 
Suggests New Procedures 24 NIT) 
Raises New Issues .00 ey 
Presents Facts Effectively 24 18 
Makes Decisions Effectively 16 NG 
Amount of Talking Pal ele 
Attempts to Influence TEL .O7 


Friendliness —.03 —.02 
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TABLE 34. Correlations of two content scores with categories of instruc- 
tional awareness and job performance values 


Organizational 
Imaginative Change 
Instructional Awareness 
Objectives 41 09 
Evaluation 152. .O7 
Planning 33 .O9 
Curriculum 37 20 
Participation oe 18 
Interest .26 .20 
Growth .30 tv 
Methods 34 19 
Materials 29 13 
Personality 0) Eo 
Classroom .08 08 
Climate 16 .O9 
Job Performance Values 
Instruction 31 16 
Pupils Psi he) 
Employees 225 ‘L6G 
Physical (a5) 04 
Structure om iN 
Public .O9 14 


formance values that were obtained from the teacher evaluation prob- 
lems presented on kinescopes and from the educational problems pre- 
sented on tapes (Table 34). (See Chapter 9 for a description of these 
variables.) Some of the correlations are fairly high; for example, Imag- 
inative correlated .41 with the instructional awareness category score, 
Objectives. Although there are exceptions, the high correlations tend to 
involve concerns with those educational matters which imply a high 
level of professional insight and which involve abstract concepts (e.g., 
Objectives, r = .41; Curriculum, r = .37; Methods, r = .34; Planning, 
r = .33; and Evaluation, r = .32), in contrast with more concrete and 
perhaps superficial concerns (Climate, r= .16; Classroom, r = .08; 
and Materials, r= .29). The correlations with concerns expressed in 
the tape problems permit a similar interpretation. 

The correlations involving Organizational Change show a some- 
what similar pattern but tend to be lower. Organizational Change has 
relatively much lower correlations with Objectives (r = .09) and Eval- 
uation (r = .07), and a higher correlation (relatively) with Interest 
i= 20). 
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WITH SUBJECTIVE EVALUATIONS 

Table 35 presents the correlations of the two content scores with 
the various subjective evaluations that were made of the work of the 
232 principals. These evaluations include: (1) an over-all evaluation 
of the principal’s work in his own school, made by two or more of his 
superiors, (2) an average of the over-all evaluations made by each of 
the scorers on completion of the scoring of her part of the in-basket 
test, (3) an evaluation made by two or more members of the research 
staff at the end of the test week, (4) the mean score on the Teacher 
Reaction Form, the questionnaire filled out by all teachers serving 
under each principal in his home school, and (5 and 6) the Considera- 
tion and Initiating Structure scores from the Principals’ Behavior De- 
scription Questionnaire, also filled out by each teacher to describe his 
principal’s behavior. A full description of each of these scores will be 
found in Chapter 9. 

The scorers’ rating has a high correlation with both content scores, 
especially the Imaginative score (r= .58 as compared with .42). 
Since the scorers’ ratings are based on their examination of the same 
materials that produced the content scores, there is a certain amount 
of spurious dependence which increases the correlations. Nevertheless, 
the correlations can be interpreted as indicating that scorers tend to give 
high ratings to principals who took many imaginative actions and pro- 
duced many organizational changes, especially the former. 

Staff members also tended to give high ratings to principals who 
are high on Imaginative and Organizational Change scores (r = .32 
and .26). Superiors tend very slightly to prefer principals with high 
scores on Imaginative (r = .20), but their preferences are unrelated 
to Organizational Change (r = .09). 

Scores on the Teacher Reaction Form correlate with both content 


TABLE 35. Correlations of two content scores with over-all subjective 
evaluations 


Organizational 
Imaginative Change 
Superiors’ Rating .20 .O9 
In-basket Scorers’ Rating 58 42 
Staff Members’ Rating 2 26 
Teachers’ Reaction Aly Vile 
Consideration .O7 20 


Initiating Structure .06 —.11 
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scores at a marginally significant level (r = .17 and .16), and the Con- 
sideration and Initiating Structure scores are unrelated to imaginative- 
ness (r = .07 and .06); but the correlations with the Organizational 
Change score present an interesting problem in interpretation. At least 
on the basis of the names of the variables, one would expect high cor- 
relation between Initiating Structure and Organizational Change and a 
zero or perhaps negative correlation between Consideration and Or- 
ganizational Change. Instead we find a significant positive correlation 
of Consideration with Organizational Change (r = .20) and a negative 
(although nonsignificant) correlation with Initiating Structure (r= 
—.11). 

An explanation of this paradox can perhaps be found by examining 
more closely the two measures in question—lInitiating Structure and 
Organizational Change—and their correlations with other measures. 
Initiating Structure is a score based on teachers’ responses to 15 ques- 
tionnaire items, such as: 


He makes his attitudes clear to the faculty. 

He rules with an iron hand. 

He criticizes poor work. 

He lets faculty members know what is expected of them. 


The Organizational Change score is a count of the number of courses of 
action taken in response to in-basket items which have been keyed for 
this variable. They include such courses of action as “clarify respon- 
sibility of custodian,” “remind Ruth Platz to obtain phone numbers on 
memo,” “appoint faculty committee to study the problem,” “formulate 
a set of regulations,” “have policy established,” and “change lunch 
schedule.”” Examination of both variables at this level suggests that 
there is considerable similarity between the two measures. But there 
are three additional considerations to keep in mind about the Organiza- 
tional Change score: (1) The course of action need not actually be 
taken in order to be scored; the subject may have merely planned to 
take the action or he may have only considered it. (2) The course of 
action taken may be one which was proposed to the subject by some- 
one else. (3) Content scores are influenced by the total productivity of 
the subject—his responding to many items and taking many courses of 
action. Therefore, there may be much less initiative involved in pro- 
ducing organizational changes than is implied by the name of the score. 

When we examine the correlations of Initiating Structure and Or- 
ganizational Change with other variables, we find some interesting con- 
trasts. Here are the correlations with some ability measures: 


160 ADMINISTRATIVE PERFORMANCE AND PERSONALITY 


INITIATING ORGANIZATIONAL 


STRUCTURE CHANGE 
Social studies —.20 46 
Science and mathematics —.20 2 
Deductive reasoning —.10 atl 
General reasoning —.19 ral 


Those high on Organizational Change tend to be brighter and better 
educated than those who are low, while the opposite is true for Initiat- 
ing Structure. 

Here are correlations with some other measures: 


INITIATING ORGANIZATIONAL 


STRUCTURE CHANGE 

Strong Vocational Interest Blank for Men: 

President Manufacturing Concern .26 —.04 
Basic Personality Factor: 

Character Strength 2) —.15 
In-basket Composite C: 

Complying with Suggestions* —.12 ek 
In-basket Composite E: 

Maintaining Relationships* —.01 35 
In-basket Composite G: 

Responding to Outsiders* —.07 poit! 
In-basket Composite H: 

Directing Work* 02 29 


* These scores are defined in Chapter 12. 


It seems that the Organizational Change score is not a measure of 
strong aggressive leadership; on the contrary, it is associated with tend- 
encies to act in compliance with suggestions and to please superiors and 
outsiders. Initiating Structure is unrelated to these characteristics in in- 
basket behavior and is associated with interests like those of presidents 
of manufacturing concerns and school supervisors. Those high on Ini- 
tiating Structure tend to be high on Character Strength; that is, they are 
conscientious and tend to behave in accordance with standards imposed 
by society. 

Organizational Change seems to represent behavior which involves 
controlling others, not through strong personal leadership but as a way 
of complying with the wishes of others. While the high correlations 
with tests of reasoning and academic achievement are in part artifactual, 
there may be a tendency for those high in Organizational Change to be 
superior in intellectual attainments. 

Table 36 presents the correlations of content scores with the su- 
periors’ rating of 12 aspects of the principals’ work. The over-all su- 
periors’ rating correlated .20 and .09 with the two content scores (Table 


THE CONTENT SCORES OF THE IN-BASKET TEST 161 


TABLE 36. Correlations of two content scores with superiors’ ratings 


Organizational 
Imaginative Change 
Interest in Work ae at 
Sticking to a Job BY 10 
Getting Along with Teachers .08 .O9 
Getting Along with Parents —.01 .03 
Getting Along with Supervisors .06 .03 
Knowledge of Administration 23 .O9 
Knowledge of Teaching Ae .O7 
Rapport with Children .03 —.02 
Written Communication el] 09 
Understanding 8) 14 
Oral Communication (Formal) 23 10 
Oral Communication (Informal) £25, 20 


35). We see that only one of the more detailed ratings correlates sig- 
nificantly with Organizational Change. Imaginative is associated slightly 
with interest in work (r = .23), knowledge of the job (r = .23 and .29), 
understanding (r = .23), and oral communication skills (r = .23 and 
.25); but it is unrelated to superiors’ judgments of ability to work with 
other adults or with children. 

Table 37 shows the correlations of the items in the scorers’ Adjective 
Check List with the two content scores. The correlations of the scorers’ 
over-all impression with Imaginative and Organizational Change scores 
were .58 and .42 (Table 35). The correlations in Table 37 are all 
lower for the adjectives than for the over-all rating. When we compare 
the correlations between adjectives and scorers’ ratings with the correla- 


TABLE 37. Correlations of two content scores with items of scorers’ Adjec- 
tive Check List 


Organizational 
Imaginative Change 
Urbane 56 38 
Forceful .40 aot 
Slipshod —.44 —.25 
Cold —.08 —.04 
Resourceful a3 .28 
Logical 48 26 
Tactful 133 lS 
Wordy 42 14 
Courteous BLS .O7 


Witty 33 20 
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tions between adjectives and content scores, we find about the same rank 
order of correlations, except that imaginativeness apparently implies 
a little more “wordiness” and a little less “forcefulness” than does the 
scorers’ over-all rating. 


Those who earn high scores on the Imaginative content score are 
likely to be bright, well-educated people. They get high scores on tests 
of professional knowledge and general culture and are high especially 
on the cognitive ability tests of verbal knowledge and fluency. In the 
in-basket situation they are characterized by much exchanging of in- 
formation and discussion but not by compliance. In-basket scorers rate 
them high; the staff tends to give them high ratings, but the superiors’ 
over-all rating has only a small relation to imaginativeness. In the in- 
teraction situation, high scorers tend to suggest procedures and ask for 
information and to be rated high on effectiveness in presenting facts. 
They express concerns about a wide variety of educational problems in 
the filmed and taped items. High imaginativeness tends slightly to go 
with lack of conventional standards and with emotional sensitivity. With 
respect to interests, the most imaginative principals tend to resemble 
psychologists and, to a lesser extent, lawyers, and to be different from 
policemen, accountants, and production managers. 

The Imaginative score may be thought of as an evaluation of the 
quality of the intellectual performance of the principals in the in-basket 
situations as viewed solely from the standpoint of the content of their 
actions; the score represents the number of “good ideas” produced. 
This performance is highly predictable, especially from tests of profes- 
sional knowledge such as the School Administration and Supervision 
Test. 

Organizational Change, as measured by the content score, does not 
measure strong aggressive leadership so much as a tendency to make 
changes in the organization as are required to please outsiders and superi- 
ors or in compliance with suggestions. This content score has fairly high 
correlations with tests of professional knowledge and general achievement 
and is relatively more closely related to visualization, verbal knowledge, 
and reasoning than to fluency. Those with high scores on Organizational 
Change tend to be rated high by scorers and by staff members. Teachers 
tend to view them as considerate rather than as high on initiating struc- 
ture. High scorers tend slightly to express concerns about teacher per- 
sonality in evaluating teachers, but generally Organizational Change 
has little relation to number of concerns expressed about educational 
problems, 


Chapter 9 


CONCERNS AND VALUES OF 
ELEMENTARY SCHOOL PRINCIPALS 


IN EARLIER CHAPTERS, ATTENTION HAS BEEN FOCUSED ON SCORES 
which describe the behavior exhibited by principals in handling their in- 
basket problems. Some of the categories used to score in-basket re- 
sponses describe performance from the standpoint of content and some 
from a stylistic point of view. A few of the stylistic categories, such as 
Uses Human Values, presumably reflect underlying attitudes and values 
of the principals. In this chapter further attempts to measure the con- 
cerns and values which may be inferred from the responses of prin- 
cipals in problem situations other than those represented in the in-basket 
tests will be described. 

One of the important responsibilities of the elementary school prin- 
cipal is the supervision of instruction. During the test week, the prin- 
cipals of Whitman School were required to observe teachers teaching, 
as presented in kinescopes. On another occasion, they were asked to 
participate in tape-recorded conferences on educational problems. Dur- 
ing the first day of the test week, when the principals were learning about 
Jefferson and Whitman School, examination booklets were distributed 
which required each principal to list some salient problems and charac- 
teristics of the school and community. Ali three of these problem situa- 
tions were relatively unstructured. As in a projective test, variations in 
response could thus be expected to reflect the attitudes, values, and con- 
cerns of the respondents. 
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THE KINESCOPES 


Three kinescopes were made in order to provide the principals with 
opportunities to demonstrate their abilities in supervisory situations. 


THE TASK 

The principals were informed that in this phase of their work, they 
were to visit the classrooms of the three probationary teachers in Whit- 
man School. These visits were made by viewing three 15-minute kine- 
scopes of the teachers working with their classes. The projector was 
stopped at the end of each visit and each principal was asked to com- 
plete a probationary report form and to outline the interview which he 
planned to have with the teacher observed. School system regulations 
required that this interview be conducted before the completed report 
form is submitted to the superintendent. 

The probationary report form was typical of those that are now in 
use for this purpose. It provided for free responses to items dealing with 
personal appearance, pupil response, attitude, achievement, classroom 
control, classroom techniques, professional alertness, and suggestions 
for improvement. The response sheet which was provided for the in- 
terview outline simply stated, “Outline how you would conduct your 
interview with —-___——_, indicating each point you intend to cover.” 
After viewing each kinescope, the principals were allowed 15 minutes 
to complete these two forms. 


DESCRIPTION OF THE KINESCOPES 

Kinescope I: Mildred Kramer. Mildred Kramer was a first-year 
teacher of the fifth grade in Whitman School. Marion Smith had en- 
countered a number of problem items in previous in-basket test situa- 
tions in which Miss Kramer was involved. As he entered the classroom, 
a social studies lesson was in progress. Miss Kramer was standing at 
the front of the room clutching her open geography book. This text- 
book remained open throughout the entire lesson and Miss Kramer re- 
ferred to it quite often during the course of a question-and-answer pe- 
riod. The observed lesson dealt with the geography of the Middle 
Atlantic states. The children of the class were seen in various activities, 
some obviously not engaged in learning geography. As the lesson pro- 
gressed, the class remained orderly and to some extent responsive. 
However, disinterest in the lesson was evident. Some children were 
reading other material hidden inside their geography textbooks, while 
others were simply idling away time by drawing on the board or note- 
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book. Some lack of organization was noted in the way books were dis- 
tributed and collected. 

The maps and charts on the board were rather poorly done and 
contained errors and misspellings. During .’_urse of the 15-minute 
visit, Principal Smith observed Miss Kramer drawing from her textbook 
numerous questions on the geography of the eastern seaboard and di- 
recting these questions to a small number of selected students in 
the class. During the short session, Miss Kramer found occasions to 
make critical remarks about the principal, to squelch a pupil who doubted 
the accuracy of the material in the textbook, and to punish a child by 
assigning additional homework because he had lost the place in the text- 
book. 

Kinescope II: Evelyn Waters. The second kinescope visit was made 
to the classroom of Evelyn Waters. Mrs. Waters, a third-grade teacher 
at Whitman, although somewhat older than Miss Kramer, was also a 
first-year teacher in the Jefferson district. This class was working on 
social studies and was busy with a unit centered around “community 
helpers.” There were numerous charts and posters depicting people 
engaged in various community services. In general, the room was 
rather neatly arranged and the posters were of high quality. Mrs. Waters 
discussed some of the previous day’s activities with the class. Follow- 
ing this discussion, they decided which of the community helpers they 
would like to study next. Mrs. Waters divided the class into small groups 
for the purpose of deciding the important things which they would like 
to find out about community helpers. The groups worked quietly for a 
short period of time before coming back together as a class. A spokes- 
man for each group reported on the major interests of the group mem- 
bers. The teacher recorded these areas of interest on a chart as the 
children related them to her, rewording the ideas of the children before 
writing them down. At the same time, she encouraged the slower pupils 
as they attempted to make contributions to the class discussion. A 
majority of the class contributed to the discussion. Near the end of the 
visit, various committees made up of class members were formed. 
Each committee was given a definite assignment which involved finding 
out something about the work of a specific community helper. 

Kinescope III: Eugenia Walenski. The third visit was made to the 
first-grade classroom of Eugenia Walenski. Unlike the other two teach- 
ers, Miss Walenski was in her second year at Whitman, although still 
on probationary appointment. (The in-basket material with which the 
principals had worked for the previous day and a half had provided 
this information, but they were not reminded of these facts; the informa- 
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tion about Miss Walenski indicated the existence of some problems in 
her teaching. ) 

As the principal entered the room, the children were involved in 
many different activities at various points around the classroom. Some 
were reading, others were working with science equipment. Still others 
were counting together and working with large numbers. The children 
were not unruly, but there seemed to be little coordination of the vari- 
ous activities going on in the classroom. Miss Walenski was seated at 
her desk, where she remained throughout the visit. She was talking 
with one of the children about a book which the child had been reading. 
The discussion consisted primarily of a series of simple queries punc- 
tuated by highly dramatic “ohs” and “ahs” on the part of Miss Walenski. 
She called the class together by ringing a bell and proceeded with a 
“‘ouess-what-is-going-to-happen-next!” type arithmetic lesson. Miss 
Walenski emphasized the importance of good work to her first-grade 
children by awarding gold stars to those who completed the mimeo- 
graphed arithmetic seatwork. Some confusion was evident when the 
teacher failed to give clear directions for the assignment. 


SCORING THE PRINCIPALS’ RESPONSES 


Since the probationary report form and the interview outline made 
possible free responses on the part of each of the subjects, wide latitude 
in writing reactions to the three classroom visitations was possible. 
Some structure was provided in the probationary report form in that 
key words tended to suggest certain specific responses. 

At least two avenues seemed possible for analyzing the responses of 
the Whitman principals. One of these was to examine what the prin- 
cipals did or planned to do about the performance of each of the three 
teachers. The second possibility was to use the principals’ responses as 
indicators of awareness of instructional problems as they planned the 
supervisory conference and evaluated each teacher. Since it was felt 
that responses to these materials were most appropriate for determining 
the principals’ expressed awareness of instructional issues, the latter 
procedure was chosen. Information of this type made possible the study 
of the principals’ performance of the supervisory job in terms of the 
concerns they deemed most important in the instructional situation. 

As a preliminary step, a content analysis was made of the responses 
of 21 randomly selected principals. Their 21 response records were 
thoroughly examined, and each phrase or idea that exemplified an 
awareness of some aspect of instruction was abstracted. These phrases 
and ideas were then examined by several students and professors of 


CONCERNS AND VALUES OF ELEMENTARY SCHOOL PRINCIPALS 167 


elementary education, and a classification of “categories of instructional 
awareness” was developed to include all the ideas expressed in this 
sample of responses. This procedure resulted in 12 categories which 
were revised several times and carefully defined. These categories are 
listed below, with definitions and examples for each category: 


1. 


Objectives—References to aims, purposes, goals, or objectives of 
the teaching situation. 
EXAMPLE: ‘“‘What did you aim to teach?” 


. Evaluation—Concern for pupil achievement, summary of learning, 


evaluation of the lesson, or a test situation. 
EXAMPLE: “What do you think the children learned during this 
period?” 


. Planning and Continuity (Planning)—Concern with the planning of 


the lesson, utilization of time, pupil-teacher planning, establishing 
study questions, planning for future, reference to a previous lesson. 
EXAMPLES: “Planning of work should be done by blocks of in- 
terest.” 
“What are your plans for the future?” 
‘What is the next step?” 


Curriculum—Concern for the content of the subject being taught 

and the scope and sequence of the lesson. 

EXAMPLES: “Don’t you think you tried to cover too much?” 
“Seasonal materials—good.” 


Pupil Participation (Participation)—Concern for the children taking 

part in class activities, through discussion, establishing study pro- 

cedures, group work, panels or reports, and the like. 

EXAMPLE: “Secure more participation—be aware of the whole 
class.” 


Motivation—Pupil Interest (Interest)—Concern for the problem of 
stimulating the learning situation, the interest of the pupils, co- 
operation of the pupils, and the teacher’s motivational techniques. 
EXAMPLES: “Teacher used good motivation materials.” 
“The children remained interested throughout the les- 
son.” 


. Child Growth and Development (Growth)—Concern for individual 


differences of boys and girls, provisions made for rapid learners or 
slow learners, understanding of emotional and intellectual needs of 
children. 
EXAMPLES: “Kindness shown to forgetful child.” 

“Outcomes related to pupil growth.” 

“Draw out the slow ones.” 

“No provision for individual differences.” 

“Why are all the pupils at the same level?” 


. Methods of Instruction (Methods)—Comments regarding particular 


techniques used by the teacher in handling her class or in presenting 
content material. 
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EXAMPLES: “Find the word ‘five’, now find the number ‘5’.” 
“Lesson was skillfully guided, but not dominated.” 
“Need to improve in using this particular technique.” 
“Excellent opportunity for use of the group procedure 
in learning.” 

9. Materials of Instruction (Materials)—Comments regarding the avail- 
ability of instructional materials, books, maps, and the like, suitabil- 
ity of materials for the group being taught, and care of instructional 
materials. 

EXAMPLES: “Let the children handle materials.” 
“Use large map.” 
“Comment on the bulletin board.” 

10. Personality of Teachers (Personality)—Concern for personal charac- 
teristics relating to voice, manner, appearance, attitude, emotional 
stability, dependability, and alertness of the individual teacher. 
EXAMPLES: “Voice too low.” 

“Speak slower—smile.” 

11. Physical Setting—Classroom (Classroom)—References to the ar- 
rangements of the room, the furniture, centers of interest, and gen- 
eral attractiveness. 

EXAMPLES: “Attractive room.” 
“Regroup the furniture.” 
“Classroom too crowded.” 
“Bulletin boards very attractive.” 

12. Classroom Climate—Routine (Climate)—Concern for classroom 
routine, roll call, housekeeping duties, distribution of material, 
changing of activities. Also, the emotional and social climate of the 
class group. 

EXAMPLES: “Have materials of instruction ready.” 
“Improve the distribution of materials.” 
“A free democratic atmosphere prevailed.” 
“T am sure pupils enjoyed your class.” 


Each response sheet was rated for each of the 12 categories on a 
five-point scale, the number 5 indicating that, in the opinion of the 
scorer, the subject exhibited a high degree of awareness of a particular 
category, and a score of | indicating an absence of any expression of 
awareness of the category. Care was taken to minimize subjectivity in 
the scoring procedure. Three doctoral students at Auburn University 
were employed to carry out the rating task. Each of these men was ex- 
perienced in supervising instruction in elementary schools. These raters 
had not previously engaged in any phase of this undertaking; they had 
not viewed the kinescopes; and they could not identify, individually or 
geographically, any of the subjects being scored. 

A training session was conducted at which the categories of instruc- 
tional awareness were defined and discussed by a member of the re- 


CONCERNS AND VALUES OF ELEMENTARY SCHOOL PRINCIPALS 169 


search staff and the three scorers. A preliminary run was made in which 
each of the scorers and the staff member scored together and discussed 
several of the respondents’ papers. After this training period, the three 
scorers independently rated each principal, carefully following the defi- 
nition of each category. Each principal was rated on the five-point scale 
for each of the 12 categories separately for his responses on Kramer, 
Waters, and Walenski. This scoring procedure resulted in three inde- 
pendent scores on each category for each of the three teachers. 

To obtain total scores, the ratings of the three judges were com- 
bined by computing a mean rating for each of the three teachers. The 
mean ratings on each of the three teachers were then summed; this 
yielded a score for each category ranging from 3 to 15 for each principal. 
A score of 3 indicates a complete absence of instructional awareness on 
a given category, while a score of 15 represents a definite awareness of 
the instructional concern. 


RELIABILITY OF THE RATING PROCEDURE 

An intra-class correlation coefficient was computed for each of the 
12 categories, the three kinescopes constituting the classes in the com- 
putations. The obtained coefficients were adjusted by the Spearman- 
Brown formula to correct for the use of three kinescopes. Table 38 
presents the estimated reliability of each of the scoring categories, to- 
gether with the means and standard deviations of these scores. 

These reliability estimates reflect both the amount of consistency 


TABLE 38. Means, standard deviations, and reliability estimates for 12 
categories of instructional awareness 


Category of 


Instructional Mean S.D. Estimated 
Awareness Reliability 
Objectives 5.74 3.01 Ful, 
Evaluation 6.86 2D ial 
Planning 8.93 3.19 .67 
Curriculum 7.44 2.46 .66 
Participation 12.98 1.65 50 
Interest 13.78 hal by BY 
Growth Gray, 2.19 .68 
Methods 13.01 1.41 .64 
Materials 8.87 3.43 .63 
Personality 14.05 .90 .67 
Classroom 6.37 2.84 50 


Climate B13 1.48 58 
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of the principals’ performance across the three teachers they evaluated 
and the amount of agreement among the raters. For example, those 
principals who were judged to be aware of Objectives in rating Kramer 
tended also to be judged aware of Objectives in evaluating Waters and 
Walenski. These concerns, as reflected by the 12 scoring categories, 
tend to be consistent instructional awarenesses of the principals. 


ANALYSIS OF RESPONSES TO THE KINESCOPES 

Although scores were assigned separately for each of the 12 scoring 
categories, these categories may not represent basically independent 
areas of instructional awareness. In order to achieve a better under- 
standing of the basic awarenesses or concerns that were scored by use of 
the 12 categories, factor analysis was used to examine their interrela- 
tionships. Table 39 presents the intercorrelations among the 12 cate- 
gory scores for the 232 principals. The factor analysis involved the 
correlations reported in Table 39. Communalities were estimated as 
equal to the highest correlation in the row or column, and the character- 
istic roots and vectors of the resulting matrix were then computed. The 
12 roots were inspected, resulting in a decision to obtain loadings for 
four factors. Table 40 shows the unrotated and the rotated factor 
matrices. Residual correlations, shown above the diagonal of Table 
39, are uniformly quite small. 

Rotations from the orthogonal factor matrix to the oblique factor 
matrix were guided by the criteria of simple structure and were done by 
inspection of successive plots of the loadings of the category scores on 
pairs of factors. The final transformation matrix and the intercorrela- 
tions among the oblique factors are given in Table 41. 

The four factors show a considerable degree of positive intercorrela- 
tion, ranging from .27 for Factor A with Factor C to .69 for B with D. 
These correlations indicate that although distinctions can be made be- 
tween the four factors of instructional awareness, all have a substantial 
common core. 

Factor A, as shown in Table 40, is characterized by high loadings 
on Objectives, Evaluation, Planning, and Curriculum. For each of 
these categories, the factor loading is .49 or above. It may also be 
noted that a loading of .27 appears for Growth and a loading of .29 
for Materials. The large amount of variance that is accounted for by the 
first four categories, however, indicates that this factor is primarily re- 
lated to aspects of the educational program and, therefore, it has been 
captioned Concern for Educational Program. 

Factor B is characterized by loadings of .62 and .48 on Participation 
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and Interest, respectively. Concern for Pupil Reactions has been used 
as the descriptive title for this factor. 

In the case of Factor C there are loadings of .60 for Materials, .55 
for Classroom, .36 for Climate, and .35 for Curriculum. This factor 
has been labeled Concern for the Physical Aspects of Instruction. 

Factor D is characterized by loadings on Personality of .46 and on 
Methods of .37. This factor has been labeled Concern with Teacher 
Behavior. 


FREQUENCY OF RESPONSES 

Frequency distributions of the scores for each of the 12 categories 
of instructional awareness are reported in Table 42. The categories have 
been arranged in accordance with the results of the factor analysis. A 
rather interesting pattern is revealed in the examination of this fre- 
quency distribution. 

The first four categories, which account for most of the loading on 
Factor A, produced high frequencies at the lower end of the scale. Thus, 
a very large percentage of the principals expressed little or no concern 
for the educational program. A contrasting frequency pattern was ob- 
tained for the two categories which loaded on Factor B and the two with 
high loadings on Factor D. A high percentage of the principals indicated 
considerable awareness for pupil reactions and teacher behavior. The 
categories loading on Factor C, Physical Aspect of Instruction, elicited 
high frequencies at the lower end of the scale (except for Climate). 

It is possible that the cues which were present on the probationary 
report form influenced the frequency of response on the various cate- 
gories. This form provided key words which might have suggested re- 
sponses in the areas covered by factors Pupil Participation and Teacher 
Behavior. The interview outline, although free of such cues, was com- 
pleted after the subjects had completed the probationary report form, 
which may have increased the probability of a carry-over of cues from 
the probationary report form to the task of preparing the outline. On 
the other hand, several cues which were listed on the probationary form 
did not elicit written expressions of concern to the level which seemed 
to merit including them as categories of awareness. It can be assumed 
that the manner in which content categories were derived served to re- 
duce somewhat the effect of the specific testing materials on the fre- 
quency of response within each of the 12 categories. The responses were 
obviously made to what the principals saw in the kinescopes, and what 
they saw was not necessarily representative of teacher performance in 
general. The limited period of observation (15 minutes per teacher) 
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may have tended to preclude the observation of behavior relevant to 
long-term educational objectives. 

For the reasons given in the above paragraphs, no attempt will be 
made to generalize about the principals’ supervisory behavior from the 
frequency pattern noted in Table 42. But a number of intriguing ques- 
tions are suggested by the findings. Are elementary school principals 
more concerned with pupil reactions and teacher behavior than with the 
educational program? Do principals place very high values on teacher 
personality, method of instruction, pupil interest, and pupil participa- 
tion, and neglect such matters as the purpose of a learning activity, the 
scope and sequence of the lesson, planning of the learning activity, and 
the evaluation of learning outcomes? Do these variations in frequency 
among the categories reflect the programs under which these principals 
were trained? If these differences are not merely artifacts of the method 
and materials used in this investigation, but are a true indication of on- 
the-job behavior of elementary school principals, the findings have great 
significance for the training of elementary school principals. 


THE TAPE RECORDINGS 


Another phase of Thursday afternoon’s work was presented in the 
form of tape recordings. Five different problem episodes were presented. 
The principals were instructed to consider the problems raised in each 
recording as it related to the role of principal of Whitman School. After 
listening to each of the taped situations, the principals were allowed six 
minutes to respond to a set of four open-ended questions. A brief de- 
scription of each of the situations is given below, along with the ques- 
tions for each episode. 

The First Episode. This tape recording presents a conference led 
by the school psychologist. The other people involved in the conference 
were a sixth-grade Whitman teacher, one of the other teachers in Whit- 
man School, and the school nurse. They devoted the conference to a 
discussion of the problems of a sixth-grade pupil, Dick, who was above 
average academically but had social adjustment problems. He seemed 
insecure and withdrawn, with definite compulsive tendencies which were 
expressed in extreme neatness and a marked preference for routine ac- 
tivities. The group aired many facts and opinions about Dick, his school 
work, his home life, and his parents. The conference was then inter- 
rupted, and Marion Smith was asked to answer the following questions: 
(1) What do you see as the problem? (2) How would you involve 
Dick’s parents in meeting this problem? (3) What would you advise 
Mr. Kelley, Dick’s teacher, to do to help Dick with his problem? (4) 
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What role would you have Dr. Silverstein, the psychologist, take in 
working with Dick? 

The Second Episode. This was an audio presentation of a confer- 
ence between the second-grade teacher, Mrs. Schultz, and the mother of 
one of the children in her class. The mother was concerned with the 
progress her child was making in reading, and the teacher succeeded in 
guiding the discussion in a cordial, if somewhat evasive, manner. Several 
times during the conference the problem of reading was introduced by 
the mother, and the teacher carefully changed the course of the conver- 
sation to some other subject area. The following four questions were 
presented to the principal after this tape-recorded episode was inter- 
rupted: (1) What would you say to Mrs. Schultz in criticism of the 
manner in which she conducted the conference? (2) Did this conference 
accomplish anything toward the school’s general objective? If so, what 
and how? (3) What impressions did you receive regarding Mrs. Schultz 
as a classroom teacher? (4) How would you evaluate Robert’s school 
progress? 

The Third Episode. A short address by Dr. Donnelly, the Superin- 
tendent, at a PTA meeting was presented on this tape. The Superintend- 
ent devoted a major part of his address to the plans that were under way 
for an addition to one of the buildings. The speech provided many cues 
about the personality of the Superintendent. He quite skillfully placed 
the burden for the educational program of the community on the parents. 
The following four questions were presented to the principals when the 
recording ended: (1) If plans for the new addition to the junior high 
school are disapproved by the community, what implications would that 
fact have for you at Whitman? (2) Has listening to this talk given you 
further insight into Dr. Donnelly’s personality? If so, what? (3) During 
his address, Dr. Donnelly reveals something of his general philosophy 
regarding the place of physical facilities in the education of children. 
What one of his views did you consider most significant for you as 
principal of Whitman School? Why? (4) The day after the address, 
Dr. Donnelly called each of his principals on the phone and said, “I 
noticed you were at the PTA meeting last night and am anxious to know 
how you think my talk was received. Would you jot down any ideas you 
have about anything we could do to ensure that the proposed additions 
receive approval?” 

The Fourth Episode. This tape recording presented a part of a spe- 
cial annual meeting attended by the members of the Board of Education, 
the Superintendent, the Assistant Superintendent, and the principals. 
The topic of discussion concerned the school’s responsibility for malad- 
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justed children in the school system. Considerable give and take 
occurred among the discussants as the meeting progressed. Several indi- 
viduals cited specific instances of pupil behavior which might be con- 
sidered delinquent. At the conclusion of the recording, the principals 
were asked to respond to the following questions: (1) The President of 
the Board turns to you at the end of the recording and says, “You are 
new in our system this year; what are your ideas about the adequacy 
of our guidance activities in the elementary schools?” Outline your 
answer below. (2) In your opinion, are the policies in Jefferson schools 
too lenient toward the maladjusted child? Why? (3) What plans do 
you have for handling the problems of the troublesome child at Whitman 
School? (4) How would you report the substance of this discussion 
you have heard to your teachers? What do you do or say? 

The Fifth Episode. The final tape-recorded episode was another 
part of the special meeting with the Board of Education. The topic 
under consideration at this time was the teaching of foreign languages 
in the elementary school. In the course of the discussion, considerable 
attention was given to the desirability of major curriculum changes and 
to the costs of a foreign language program. The Superintendent appeared 
to dominate the discussion. When the recording was finished, the princi- 
pals were again allowed six minutes to answer the following four ques- 
tions: (1) The discussion of foreign languages in the elementary school 
continued after the end of the recording. Dr. Donnelly turned to you 
and asked, “What is your view, Marion, on teaching foreign languages 
at Whitman?” Write your reply below. (2) Do you think Dr. Don- 
nelly’s estimate of the cost ($25,000) of a foreign language program in 
the elementary schools is realistic? Why? (3) How would you respond 
to the community pressure to teach foreign languages in the elementary 
school? (4) What criticism do you have of Dr. Donnelly’s plan to begin 
the teaching of foreign languages in the seventh grade? 


EVALUATING THE RESPONSES 

The scoring procedure used in this part of the study was very much 
like the one used in evaluating the kinescope responses, the major dif- 
ference being in the degree of specificity of the scoring categories. 
Whereas the kinescope responses were rated in terms of 12 relatively 
specific categories of awareness for instruction, the responses to the tape 
recordings were scored for six categories involving much broader areas. 
No attempt was made to rate the principals’ responses to the separate 
episodes of the tape recordings. The six categories, like those used to 
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score responses to the kinescope, were derived through content analysis. 
These categories were called “job performance values,” and are listed 
and defined below: 


1. Instruction and Curriculum (Instruction)—References to method and 
materials of instruction as well as references to the total instructional 
program. 

EXAMPLES: ‘“Doesn’t consider educational plan.” 
“The school had a program of reading.” 
“She has a somewhat balanced type of curriculum, actual 
instruction is not good.” | 
“She involves the class in numerous interesting activities.” 

2. Pupil Personnel (Pupils)—References to discipline, child growth and 
development, achievement, and to social, emotional, and physical 
well-being of the pupil. 

EXAMPLES: “Have him take a complete physical.” 
“Dick’s problem is not his school achievement.” 
“Suspend as last resort.” 

3. Employed Personnel (Employees)—References to relationships with 
and responsibility to and for teachers, other staff personnel, and 
superiors in the school system. 

EXAMPLES: “Wasn’t behind his entire staff.” 
“Did not seem to have professional attitude.” 
“J would like to know our chances of obtaining qualified 
teachers.” 
“We had no central administrative head to coordinate all 
of the personnel work.” 

4. Physical and Fiscal Organization (Physical)—References to cost of 
items and related financial factors as well as the physical environment. 
EXAMPLES: “Wants adequate and up-to-date facilities.” 

“Is the space available being used to best advantage?” 
“Explain the cost of such a program.” 

“Classrooms are placed in extremely noisy positions.” 
“Classroom space inadequate.” 

“This would bring the cost to $30,000.” 

5. Planning and Structure (Structure)—References to careful planning 

and organizational structure. 
EXAMPLES: “He thought far ahead.” 
“He probably has some long-range planning in mind.” 
“Special preparations should be made for this con- 
ference.” 
“I don’t see where this can be crowded in.” 

6. Public Relations (Public)—References to securing and maintaining 

school-community cooperation and parental support. 
EXAMPLES: “Make sure that parents are given opportunity to or- 
ganize the publicity program.” 
“I think some better school-parent relations are needed.” 
“Parents must be happy if children are to be.” 
“I'd like to have more knowledge of parental feeling.” 
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The same three individuals who rated the principals’ responses to 
the kinescopes were employed to score the responses to the tape re- 
cordings. As before, a five-point rating scale was used. A score of 1 
indicated an absence of expressed concern for a particular job perform- 
ance value while 5 expressed high concern. The raters were instructed 
to consider the responses to all five of the episodes collectively and rate 
each of the 232 principals on each of the six categories. 

Intra-class correlation coefficients were computed for the six cate- 
gories; but this time, since the five episodes were not scored separately, 
the raters constituted the classes in the computation. The coefficients 
for the six categories were corrected by the Spearman-Brown formula 
as estimates of reliability. The means, standard deviations, and reliability 
estimates are presented in Table 43. 


TABLE 43. Means, standard deviations, and reliability estimates for six 
categories of job performance values 


Estimated 

Job Performance Mean S.D. Reliability 

Value of Rating 
Instruction 11.08 2.01 49 
Pupils 11.58 1.81 36 
Employees 10.86 1.81 16 
Physical LOI33 1.88 al Hs) 
Structure 10.27 Zoo 28 
Public 11.68 1.76 Od 


These reliabilities reflect only the amount of agreement of raters; 
the consistency of behavior of the principals is not reflected one way or 
the other in these estimates. Therefore, these are not the same type of 
reliability estimates as were made for the categories of instructional 
awareness. The reliability coefficients are markedly lower than those 
obtained for the 12 scoring categories of instructional awareness, in 
spite of the fact that they reflect only rater disagreement. Three reasons 
are suggested for the low reliabilities: (1) the less precise definition of 
the categories used to score the response materials, (2) a smaller volume 
of responses (the principals’ working time on the three kinescopes to- 
taled 45 minutes, but only 30 minutes were allowed for responding to 
the five tape-recorded episodes), and (3) the less-structured nature of 
the responses to the questions following each taped episode. The low 
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TABLE 44. Intercorrelations among six categories of job performance 
values* 


Job Performance 


Value 1 2 3 4 5 6 
Instruction O01 .03 .00 —.03 —.02 
Pupils 38 .00 .0O —.01 .00 
Employees 47 ey) —.02 —.02 .02 
Physical 34 36 2, .02 .02 
Structure .41 43 38 19 .00 
Public 27, 38 .43 31 a22 


* Residual correlations are listed above the diagonal. 


reliabilities cannot be accounted for in terms of low variability of ratings. 
The size of the communalities (h?) reported in Table 45 suggests that 
these estimates of reliability may be overly conservative. 


ANALYSIS OF RESPONSES TO THE TAPED EPISODES 

The same pattern of analysis employed with the categories of in- 
structional awareness was followed in the analysis of the scores for 
taped episodes. The sums of the three ratings available for each of the 
six categories were designated as the principal scores for the respective 
job performance values. These six scores were intercorrelated, and the 
matrix of interrelationships was factor analyzed. The intercorrelations 
among the six categories of job performance values are presented in 
Table 44. 

Communalities were estimated as equal to the highest correlation in 
the row or column associated with the category, and the roots and 
vectors of the resulting matrix were then computed. The six roots were 


TABLE 45. Factor matrices for six job performance values 


Unrotated Orthogonal Rotated Oblique 

Job Performance Factor Matrix Factor Matrix h? 
Value aides untied? amin aaah aa 

I Il III A B C 
Instruction 72 —.19 sled 53 —.07 pak 8 
Pupils 76 —.05 .06 45 lA ale OM 
Employees .68 Ol —.25 9 35 —.09 aye 
Physical 47 pes 29 02 .04 45 36 
Structure 55 —.26 —.09 3 .04 —.08 38 


Public aS 37 —.16 OO 47 10 “45 
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inspected, resulting in a decision to obtain loadings for three factors. 
Table 45 shows the unrotated and the rotated factor matrices. Residual 
correlations are listed above the diagonal of the table of correlations 
(Table 44) and are very small. 

Rotations from the orthogonal factor matrix to the oblique factor 
matrix were done by inspection of successive plotting of the loadings 
on pairs of the factors and were guided by criteria of simple structure. 
The transformation matrix and the intercorrelations among the three 
oblique factors are given in Table 46. 

As in the case of the four factors of instructional awareness, the 
three factors found in this analysis of job performance values have a 
common core as reflected by correlations ranging between the factors 
of .49 and .54. 

Four of the six categories of job performance values have loadings 
on Factor A as follows: Instruction, .53; Structure, .53; Pupils, .45; and 
Employees, .39. This factor is concerned with job performance values 
relating to the planning and organizing of the internal school program. 
It has been identified by the title Internal School Program. 

Factor B is defined by loadings of .47 for the category Public and 
.35 for Employees. This factor is clearly defined by job performance 
values relating to relationship with others, including teachers, staff, su- 
periors, and parents. It has been identified as Relationships with Others. 

Factor C has a moderate loading (.45) for the category Physical and 
a small one (.21) for the category Instruction. It has been identified by 
the title Money and Material. 

The job performance values of the principal can thus be described 
by factors relating to the internal program, personnel relationships, and 
material matters. 

The mean scores on the six categories (Table 43) range from 10.27 
for Structure to 11.68 for Public. There is no marked difference be- 
tween the means of the categories that define the three factors. 


TABLE 46. Transformation matrix and correlations among factors from 
analysis of six categories of job performance values 


Transformation Matrix Intercorrelations 
FACTOR A B C FACTOR A B g 
I 54 £24 LO A 1.000 49 50 
II —.83 61 .40 B 49 1.000 54 


iil —11 —.76  .90 C fll) 54 1.000 
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RELATIONSHIPS OF CONCERNS AND VALUES TO 
OTHER VARIABLES OF THE STUDY 


In this section the relationships between a large number of other 
variables included in the study (superiors’ ratings, ability test scores, in- 
basket test scores, etc.) and four selected categories—two from the 


TABLE 47. Correlations between in-basket categories and two instructional 
awareness categories and two performance values 


Instructional Job Performance 
Awareness Values 
In-basket Category ————_—__-—————_ 
CUR- INSTRUC- 

INTEREST RICULUM PUPILS TION 

1. Asks Subordinates 14 33 Pa 28 
2. Informs Subordinates 14 gts! 24 28 
3. Discusses with Subordinates i 23 hie, PPS 
4. Communicates Face to Face 28 5 .20 Dadi 
5. Decides on Procedure 28 e235 rl m0 
6. Concluding Decision —.01 —.07 ae) .06 
7. Follows Subordinates 24 (05 26 .16 
8. Terminal Action —.10 —.15 —.03 —.13 
9. Program Values .06 14 Pip: sp 
10. Conceptual Analysis is) pes 23 1S 
11. Superiors Involved sO 09 bie 14 
12. Discusses with Superiors 14 24 24 21 
13. Outsiders Involved .10 ahs) .20 25 
14. Relates to Other Materials m0 27, 21 aR 
15. Immediate Work Scheduled .20 .07 19 18 
16. Intermediate Work Scheduled .19 18 a! 17 
17. Informs Outsiders .08 18 26 2 
18. Follows Outsiders 712 (05 1; | ‘iS 
19. Courtesy to Outsiders ,13 .20 a We 24 
20. Leading Action .03 RLG .02 ahS 
21. Courtesy to Subordinates .04 09 .03 10 
22. Directs 11 .20 .O9 ya | 
23. Careless —.03 OS .O1 —.09 
24. Delays ial —.06 —.16 —.01 
25. Informality to Subordinates .06 .O1 .02 .03 
26. Number of Words 30 30 34 39 
27. Recognition for Good Work oy, 14 16 .10 
28. Prejudges —.17 —.02 —.05 —.13 
29. Human Values 18 19 chs .09 
30. Controlled Delegation —.06 .02 —.03 —.08 
31. Uncontrolled Delegation —.06 —.03 —.09 —.14 


32. Sets Deadline 02 .09 .O3 17 
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instructional awareness area and two from the job performance values 
—will be examined in detail. The four categories chosen are (1) Mo- 
tivation—Pupil Interest and (2) Curriculum, representing the instruc- 
tional awareness area, and (3) Pupil Personnel and (4) Instruction and 
Curriculum, representing the job performance values. The selection of 
these categories was based partly on the results of a factor analysis re- 
ported in Appendix E. The four categories have the highest loadings 
on certain factors which emerged from the over-all analysis of 120 vari- 
ables from the entire study. 

Table 47 presents the correlations between 32 in-basket scoring 
categories and the five measures. 

There are a number of significant correlations in the table, although 
none exceeds .39. The highest correlations are those with the in-basket 
category Number of Words (r = .30, .30, .34, and .39), which may 
simply reflect the fact that both the in-basket task and responding to the 
kinescopes and tape recordings required writing within a restricted time 
period. The instructional awareness category Interest seems to be char- 
acteristic of principals who in their in-basket work rely on face-to-face 
discussions, perhaps with the intention of involving their subordinates 
in their work. The remaining three categories (Curriculum, Pupils, and 
Instruction) show a somewhat similar relationship with in-basket test 
work, but the relationship stresses to a greater degree communication, 
analysis, and involvement of outsiders. There is a tendency for many 
qualities of in-basket work to have slight relationships to the principal’s 
scores reflecting his concerns and values. 

Table 48 presents the correlations of Interest, Curriculum, Pupils, 
and Instruction with 15 basic mental ability tests, four tests of profes- 
sional and general knowledge, and the background achievement test. 

Although the four scores which reflect concerns and values were 
obtained from two different types of problem materials, their pattern 
of correlation with ability and knowledge tests is very similar. All show 
definite positive relationships with the School Administration and Super- 
vision Test (r = .33, .28, .25, and .32) and the examination in ele- 
mentary education (r = .33, .29, .28, and .34). All have positive re- 
lationships with the two Number Facility tests, the Verbal Knowledge 
test, and the four tests involving fluency. The over-all pattern of rela- 
tionship suggests that those principals who earned higher scores on these 
four categories tend to be well informed regarding professional issues 
and practices and fluent in expressing their reactions to the problems 
with which they were confronted. 

Table 49 presents the relationship of the four scoring categories 
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TABLE 48. Correlations of interest, curriculum, pupils, and instruction with 
tests of mental abilities, professional knowledge, and back- 
ground achievement 


Instructional Job Performance 
Awareness Values 
Tests we 
CUR- INSTRUC- 
INTEREST RICULUM PUPILS TION 
Basic Mental A bilities 
Deduction .O7 U3 aes .08 14 
Induction ae sh .07 18 
Number Facility 1 se Y 25 32 Od, 
Verbal Knowledge 22 18 fee 31 
Speed of Closure 1 oe “iS 19 34 
Associative Memory 1 .08 .08 ald .03 
Number Facility 2 36 pF8) 29 41 
Flexibility of Closure 18 gl 14 24 
General Reasoning | nO}.) 19 ca be) 
Visualization 14 Als) .04 .10 
Speed of Closure 2 .06 .00 .O1 14 
Word Fluency 24 24 we, 2 
Expressional Fluency wh) .20 lg 24 
Ideational Fluency .20 m3 18 je) 
Associational Fluency .20 .20 .20 28 
Professional and General Knowledge 
School Administration and Super- 
vision Ae 28 pay Ave 
Education in the Elementary 
School 33 JR) .28 34 
NTE Social Studies 19 .20 .20 36 
NTE Science and Mathematics 14 .07 10 ep! 
Background Achievement 
Total Score .28 .07 Lg .20 


chosen to represent instructional awareness and job performance values 
with scores in the areas of basic personality factors and interests. 

Again the patterns of correlations for the four representative scores 
are low, but they are somewhat similar. Principals who show concern on 
the two instructional awareness categories in response to the kinescopes 
and those who score highest on the two job performance values tend to 
be more emotionally sensitive, and to have interests unlike those of po- 
licemen. 

Table 50 shows the correlation of the same four scores with other 
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TABLE 49. Correlations of interest, curriculum, pupils, and instruction with 
basic personality factors and Strong Vocational Interest Blank 
for Men scores 


Instructional Job Performance 
Awareness Values 
Test Scores SaaaanE 
CUR- INSTRUC- 
INTEREST RICULUM _ PUPILS TION 
Personality Factors 
A. Friendly .0O —.05 .10 .10 
C. Emotional Stability .09 .06 .03 .06 
E. Dominance —.03 —.04 —.08 .02 
F. Enthusiastic —.01 .05 .03 03 
G. Character Strength —.04 .02 .O1 .0O 
H. Adventurous —.07 .O1 —.02 .04 
I. Emotionally Sensitive 19 09 .20 alo 
L. Suspicious —.08 —.01 —.03 —.03 
M. Non-conventional .O9 15 08 04 
N. Sophistication —.22 —.09 —.14 —.10 
O. Insecurity —.01 —.08 —.03 —.12 
Q,. Self-sufficiency .06 .06 —.02 .O1 
Q;. Will Control —.12 .06 —.06 —.02 
Q,. Nervous Tension —.03 —.09 —.02 —.05 
Strong Vocational Interest Blank 
Psychologist 10 ala 02 .10 
Policeman —.20 —.17 —.23 —.24 
Public Administration —.07 04 —.13 —.02 
City School Superintendent .O7 Aba ANS 13 
Lawyer 13 O05 .06 05 


scores in the instructional awareness area and with other job performance 
values. 

Interest in the correlations presented in Table 50 is limited to the re- 
lationship of Interest and Curriculum scores with the performance values 
and the relationships of Pupils and Instruction with the instructional 
awareness categories. (The remaining correlations were presented ear- 
lier in Tables 39 and 44.) 

It would appear from the entire set of relationships presented in 
Table 50 that a principal’s concerns or values tend to be focused in spe- 
cific areas; the fact that he is concerned with problems relative to pupil 
interest in the classroom, for example, does not mean that he is con- 
cerned about pupil personnel problems in general. 

Table 51 presents the correlations of Interest, Curriculum, Pupils, 
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TABLE 50. Correlations of interest, curriculum, pupils, and instruction with 
other category scores of instructional awareness and other job 
performance values 


Instructional Job Performance 


Awareness Values 
Category Scores a 
CUR- INSTRUC- 
INTEREST RICULUM PUPILS TION 
Instructional Awareness Categories 
Objectives 29 BY Sx .O7 25 
Evaluation 26 47 12 ap He 
Planning iN 48 11 18 
Curriculum 34 1.00 17 P45] 
Participation [Ol 33 .26 pode, 
Interest 1.00 34 24 31 
Growth 5) 42 28 28 
Methods 45 42 ape 29 
Materials 30 54 a — 
Personality 48 z2it abo sae 
Classroom .30 24 .06 212 
Climate 7 29 24 Pfs) 
Job Performance Values 
Instruction 31 ao my, 1.00 
Pupils 24 Ht Ry 1.00 58 
Employees Jee 10 peal! 47 
Physical 13 ae 36 34 
Structure 28 pall 43 41 
Public peal .02 38 | 


and Instruction with the scores from the interaction situation and with 
five biographical variables. High scores on all four of the measures ap- 
pear to be earned more frequently by women principals than by men. 
The correlation between frequency of giving positive information in the 
group interaction situation and interest possibly may be understood as 
an additional expression of emotional sensitivity of the principal who 
scores high on the category of instructional awareness. Perhaps of most 
significance is the general lack of substantial relationship between the 
four measures of concern and the biographical variables reflecting ex- 
perience and academic preparation. 

Although it is not shown in Table 51 it is worth noting that the 
three categories of instructional awareness which have high loadings on 
the instructional awareness factor, Concern for the Education Program, 
do show some relationship with both total years of experience in educa- 
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TABLE 51. Correlations of interest, curriculum, pupils, and instruction with 
group interaction category scores and biographical information 


Instructional Job Performance 
Interaction Categories and Awareness Values 
Biographical Information BS ts os ee ee, 
INTEREST RICULUM PUPILS TION 
Group Interaction Categories 
Frequency of Interaction —.01 —.04 —.14 OO 
Gives Positive Information 28 08 02 .O7 
Asks for Information .00 .06 02 .02 
Suggests New Procedures 07, —.01 —.12 —.02 
Presents Facts Effectively .06 .O1 .O1 .O9 
Makes Decisions Effectively aL —.02 —.01 18 
Amount of Talking of I} .06 .O7 14 
Attempts to Influence 04 .06 04 09 
Biographical Information 
Total Experience 04 aly) 14 .O7 
Administrative Experience —.05 Sig) .06 .07 
Academic Preparation .05 ah —.06 —.02 
Age —.02 09 .0O8 04 
sex ( Male = 1, Female = 2) 23 28 a3] 26 


tion and years of administrative experience. The correlations are as fol- 
lows: 


TOTAL ADMINISTRATIVE 
EXPERIENCE EXPERIENCE 
Objective 2 20 
Evaluation pa} 26 
Planning ih 16 


Experience may lead to concern with the educational program; but it 
apparently does not raise other areas of instructional awareness as 
measured by the scoring of responses to the kinescopes. 

Table 52 presents the correlations of Interest, Curriculum, Pupils, 
and Instruction with various ratings that were made as evaluations of 
the principal’s performance. 

Although the four scores have generally positive relationships with 
the superiors’ ratings, they differ markedly in the degree of the relation- 
ship. All four relate significantly to the item Knowledge of Teaching 
(r = .20, .17, .31, and .30). In the case of the item, Interest in Work, 
the relationship is .30 with the score Pupils but only .08 with Interest 
and .10 with Curriculum. One explanation for these apparent differences 
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TABLE 52. Correlations of interest, curriculum, pupils, and instruction with 
performance evaluations 


Instructional Job Performance 
Awareness Values 
Performance Evaluations — 
CUR- INSTRUC- 
INTEREST RICULUM __ PUPILS TION 
Superiors’ Ratings 
Interest in Work .O8 .10 .30 16 
Sticking to a Job .0O 04 - alii, Al 
Getting Along with Teachers .07 .06 18 .O8 
Getting Along with Parents —.04 —.03 ole, 05 
Getting Along with Superiors U2 .O7 119 PL 
Knowledge of Administration .06 LO .20 .20 
Knowledge of Teaching .20 aly oot .30 
Rapport with Children —.02 —.02 .O7 —.08 
Written Communication .09 .08 aS 21 
Understanding pi 4. 10 2 25 
Oral Communication (Informal) 13 —.04 Bae 21 
Over-all Impression .O9 .08 ot sabe) 
Teachers’ Questionnaire Score 
Consideration AVE .08 12 .08 
Initiating Structure 10 .06 .06 .09 
General Reaction any de 16 ol, 
Staff Members’ Ratings 
Over-all Impression 05 .03 .06 16 
In-basket Scorers’ Ratings 
Over-all Impression 24 24 ay 34 


may lie in the basic nature of the difference between the problems pre- 
sented by tape recordings and the kinescopes. The first had far more to 
do with issues in which a superior might have a direct interest than did 
the second. 

The in-basket scorers’ rating is positively related to each of the 
scores (r = .24, .24, .25, and .34). 

In summary of the correlations presented in discussion in this sec- 
tion, two general features of the relationships stand out. First, there is a 
low but positive relationship of scores on the measures of concerns and 
values with many other variables of the study. Second, concerns in this 
broad area, as measured by the methods employed in this study, do not 
appear to be general but rather specific to the context of the problems. 


Chapter 10 


PERFORMANCE ON TASKS 
INVOLVING GROUP INTERACTION 
AND SPEAKING BEFORE A GROUP 


IN THIS CHAPTER, TWO TASKS THAT REQUIRED SPEAKING RATHER THAN 
writing are described and discussed. The first task was a group interac- 
tion or committee problem. The record of each individual’s performance 
consisted of systematic observations made by members of the research 
team, and ratings obtained from the participants regarding their impres- 
sions of one another’s performance. The second task consisted of giving 
a speech to the local Whitman School Parent-Teacher Association. The 
speech was recorded on tape and later evaluated as it was replayed. 
Both tasks permitted the principals to display their effectiveness in areas 
not observable in written products of performance. 


GROUP INTERACTION PROBLEM 


School administrative positions make large demands on the ad- 
ministrator’s time for face-to-face discussions. Some implications con- 
cerning the probable style of face-to-face behavior of the 232 Marion 
Smiths can be drawn from their performance on in-basket items, e.g., 
the frequency with which they plan to discuss problems with subordi- 
nates before action. It was believed, however, that a more direct meas- 
ure of their effectiveness in a small group situation was desirable. Ac- 
cordingly, Wednesday and Thursday evenings of the test week were set 
aside for small group meetings. 
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THE TASK 


On Wednesday of the test week, at the end of the afternoon’s work, 
the principals were randomly assigned to five-person groups. After dinner 
these groups met in separate rooms, each furnished with a table and 
seven chairs. Place markers, corresponding to numbers on the assign- 
ment cards distributed earlier, indicated where each participant was to 
sit. A sixth chair at the table was occupied by a staff member who func- 
tioned as the experimenter, and the last chair was occupied by the ob- 
server, who sat away from the table in such a position that the experi- 
menter could receive a signal from him at the end of each five minutes. 
This signal permitted coordination of the data collected by the two staff 
members. 

As the subjects entered the room, they were asked to take the places 
at the discussion table indicated on their assignment cards. After every- 
one was seated, the experimenter opened the meeting by saying: 


This evening each of you is to be one of the principals in the Jefferson 
school system. It doesn’t matter much which one you are. The situation is 
this. Due to the excellent work Marion Smith did during the past year at 
Whitman School and the excellent qualifications he had for a new position 
in the Central Office as Special Coordinator of the Elementary Schools, he 
was given this new assignment. A new principal for Whitman School must 
be employed. You are the members of a special committee that has been 
appointed to assist Dr. Donnelly in making a selection. Your committee had 
one previous meeting with Dr. Donnelly and Dr. Seward and have screened 
the records of about 12 candidates and reduced the number to three. 

Beginning right now, I shall play the role of Mr. Davies, the Business 
Manager. 

I would not normally meet with this committee, but Dr. Seward is ill 
and Dr. Donnelly had to leave unexpectedly this afternoon for a special 
meeting this evening in Lake City. He asked me to chair the meeting and 
requested that I make detailed notes for a report to him. He desired that we 
try to reach a decision on which candidate we want to recommend to the 
Board. Mr. [the observer] is not part of the group, but is merely observing 
our work this evening. He will not take part in any discussion and should 
not be addressed by any of you. 

Before she became ill yesterday afternoon, Dr. Seward prepared a sum- 
mary of the records of the candidates we have. She went over the letters of 
recommendation and other materials in the folders and prepared a summary 
and abstract on each one. She thought we might start the meeting with a 
review of these records. I have a copy for each of you. Perhaps we should 
take 12 minutes and let each of you get reacquainted with the candidates. 


The experimenter then distributed one set of candidates’ credentials 
to each of the five subjects for their study. Twelve minutes later, at a 
signal from the observer, the experimenter said: 
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I guess we had better get started. Now I don’t know much about what 
you do in deciding on a candidate and I think I should stay out of the dis- 
cussion. Ill make notes and let you do the deciding. 


The set of credentials were designed to be the basis for the discus- 
sion. Each of the three candidates was presented with both positive and 
negative qualifications, and each, at the over-all level, appeared about 
equally well qualified. The 12 areas of the principals’ job that were used 
in the construction of the in-basket test items (see Chapter 4) were used 
in constructing the set of credentials. Statements in the credentials of 
each candidate included negative comments in four of the 12 areas and 
positive comments in the remaining eight. The set of three credentials 
was so patterned that the four areas of negative comments were different 
for each candidate. Materials used in preparing these credentials, with 
minor modifications, were taken directly from annual performance re- 
ports that had been prepared for all principals employed in one large 
school system. These statements, therefore, were worded in the guarded, 
if not ambiguous, language that is typical of real performance reports. 

The selection problem which the principals faced was not unfamiliar 
to them, although the choice of new teachers rather than of a new princi- 
pal was more common. The problem allowed them to bring to mind 
their experiences, values, and attitudes concerning school principals in 
general and their particular perceptions concerning the requirements of 
a principalship in Whitman School specifically. By this time in the test 
week the principals had not only experienced a day and a half of ex- 
posure to background information, but had also worked through two of 
the three school in-baskets. 

The role of the experimenter at the discussion table was consistent 
with the picture of Mr. Davies, the Business Manager, as depicted in the 
background information, which made it easier for him to remove him- 
self from the discussion. Only rarely in the course of these discussions 
were remarks addressed to the experimenter. 


COLLECTION OF DATA 


As the discussion developed, the experimenter and the observer 
made different types of records of group member interaction. The ob- 
server’s task was to tally each comment of a participant under one or 
more of the categories shown on the Categories of Interaction Record. 
This form consisted of 17 categories which are briefly described below: 

1. Gives Positive Information or Opinions: Refers to any positive in- 


formation given about a candidate, or to any support of a candidate. 
If the subject is obviously being satirical, it is not scored here. 
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EXAMPLES: “X seems qualified in many ways.” 
“X has shown real talent in raising the level of the in- 
structional program.” 


. Gives Negative Information or Opinions: Refers to any negative in- 


formation given about a candidate, or to any attack made against 
a candidate. 
EXAMPLES: “X has had some trouble with discipline problems.” 

“% is certainly not the one for this job.” 


. Supports Others’ Arguments: Refers to any agreement of one mem- 


ber with another’s arguments, points, or SUSE sone, 
EXAMPLES: “Yes, that’s true.” 
slaptee; turthermore... 


39 


. Questions or Opposes Arguments of Others: Refers to any question 


of or opposition to an argument, point, or suggestion made by an- 
other member. 
EXAMPLES: “Are you sure that what you said of X’s administrative 
ability is true?” 
“I don’t agree that X has done much in the area of 
good parent relations.” 


. Gives Information Not Related: Refers to any information offered 


that does not relate specifically to the qualifications of the candi- 
dates. Refers also to answers to questions not positive or negative 
about a candidate, whether related or not. 
EXAMPLES: “The parents in the community are very interested in 
education.” 
“Whitman School draws students from both sides of 
the railroad tracks.” 


. Asks for Information: Refers to asking others for information about 


a candidate in a nonfacetious way and in a manner that suggests 
that the question is not a “leading” one aimed at subtly tearing 
down or building up the candidate in question. 
EXAMPLES: “How old is X?” 

“What grades has X taught?” 


. Suggests Procedures: Refers to any attempt of a member to have 


others of the group follow a procedure which he suggests. 
EXAMPLES: “Why don’t we go about this logically, and decide first 
what qualities we’re looking for in a candidate?” 
“Why don’t we go about this by a process of elimina- 
tion?” 
“How about getting organized?” 


. Suggests a Role: Refers to any attempt of a member to assign a 


specific role to himself or to any other member. 
EXAMPLES: “Now, Ill go around the table asking questions.” 
“Why don’t you write down these suggestions, Mr. —?” 


. Reminds about Time: Refers to any attempt of a member to speed 


up or slow down activity of the group by mentioning the present 
time, the time limit of the discussion, etc. 


10. 


in, 


| 


13; 


14. 


1S} 


16. 
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EXAMPLES: “It’s now 8:30—we'll have to move more quickly if 
we're to finish.” 

“Now let’s not rush things; its only 8:30 and we have 

plenty of time in which to do this thing efficiently.” 


Makes Positive Personal Remarks: Refers to any personal remarks 
made in praise of other group members. 
EXAMPLES: “Mr. —, I think that’s an excellent idea.” 
“I like the sensible way you’re going about this, Mrs. 
Makes Negative Personal Remarks: Refers to any personal remark 
directed against a group member in criticism of him. 
EXAMPLES: “I don’t think your thinking is sound there, Mrs. —.” 
“TY feel that you’re all disorganized in your thinking 
here.” 


Disturbing Interruption: To be scored here, the interruption must 
be acknowledged by the original speaker; talker must stop, or slow 
down, or in some way must acknowledge the interruption. 


Raises New Issues: Refers to any attempt on the part of a member 

to raise a new issue or to change the topic at hand. 

EXAMPLES: “We haven’t yet discussed the question of whether or 
not we would prefer somebody from within the sys- 
tem.” 

“What about the problem of the particular needs of the 
Jefferson school system and how each candidate 
would fill these?” 


Suggests Criteria: Refers to any attempt of a group member to ad- 

vance specific criteria for the evaluation of candidates. 

EXAMPLES: “I think that the candidate we finally decide upon 
should have as many as possible of the following 
qualifications: se .a0 + 

“I feel that the man chosen must at least possess insight 
into the problems of his staff.” 


Summarizes: Refers to any attempt of a group member to sum- 
marize any earlier discussions. 
EXAMPLES: “Now, thus far, we have arrived at the following con- 
CLUSIONS -mearar 
“So far today we have discussed: ... .” 


This category is also used when a member mentions need for in- 
formation. 


EXAMPLE: ‘“‘We need more information on X ... .” 


Attempts a Final Decision: Refers to any attempt to end the entire 
discussion by trying to make a final decision for the group. 
EXAMPLES: “I think we have talked long enough and have made it 
clear that X is the best man for the job. Why not 
CCG tcl a 
“I propose that X be selected for the post. Shall we put 
it to a final vote?” 
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17. Out of the Field: Refers to any comments made which have no 
relevance at all to the discussion at hand. 
EXAMPLES: “Gee, it’s awfully hot in here.” 
“What are you doing tonight?” 


A taped recording of a discussion was made and used to train ob- 
servers. Separate records of interaction performance were made for 
each five-minute period. Every five minutes the observer took a new 
Categories of Interaction Form and signaled the experimenter to change 
his record form also. The observer also kept a record of any final de- 
cision reached by the group and the time such a choice was made. 

After the experimenter had given the signal for the start of the dis- 
cussion by saying, “I'll make notes and let you do the deciding,” he de- 
voted himself to keeping the Interaction Record. This was a simple de- 
vice for recording in graphic form the frequency of comments made by 
each participant and noting to whom each comment was directed. A 
single comment was defined as an uninterrupted speech or verbal con- 
tribution to the group’s discussion. A comment might consist of one or 
many sentences and might occupy little or much time. In cases where 
interruptions took place, both speakers were scored for a comment, and 
if the interrupted speaker acknowledged the interruption and resumed 
speaking, he was scored twice. 

The Interaction Record depicts the seating arrangement of the par- 
ticipating group around the conference table, the experimenter by a circle 
at the head of the table and the subjects by circles numbered consecu- 
tively around it. Each comment during the group discussion was noted 
by the experimenter in one of two ways. If it was directed at a single 
person, the experimenter drew an arrow from the circumference of the 
circle representing the speaker to the circumference of the circle repre- 
senting the individual addressed. If the comment was directed to more 
than one person, the experimenter drew arrows from the circle represent- 
ing the speaker to the center of the group. Every comment made was 
recorded, regardless of who was addressed. 

If a decision had not been reached after 25 minutes of discussion, at 
the end of the fifth five-minute period, the experimenter said: “I wonder 
if we can try to wind up things in another five minutes? Let’s try to make 
some positive report to Dr. Donnelly.” 

The sixth and last recording period followed, at the end of which 
the discussion was terminated with an expression of thanks for their 
work by the experimenter, still in Mr. Davies’ role. 

At the close of this discussion, each principal, the observer, and the 
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experimenter, filled out a Group Report Form in which he rated each of 
the five participants on six five-point rating scales: 


A. How effective was this member in presenting facts about the qualifi- 
cations of candidates? 

How effective was he (she) in assisting the group in reaching some 
decision during the discussion? 

. How extensively did he talk in the group’s discussion? 

. How often did he agree with suggestions made by others? 

. How often did he try to influence others to adopt his point of view? 
How friendly did he appear to be? 


Mindga 


Scores for a principal were determined by first obtaining a sum of 
the ratings made by his four associates. These sums were then con- 
verted into scores ranging from one (low) to nine (high). Ratings made 
by the principal concerning his own behavior were excluded from this 
score. 


CONSISTENCY OF PERFORMANCE 

Situational tests of skill in group interaction have an important and 
well-known limitation: Whatever an individual does in a group is in part 
a function of the others who are in the group with him. Each observation 
or measurement that is made in a small group interaction situation is in 
some degree a product of all the members of the group. It would easily 
be possible to gain an erroneous impression of the skill in group interac- 
tion of a somewhat retiring individual if he happened to be assigned to a 
group composed of extremely dominant individuals, or of a woman prin- 
cipal should she be assigned to a group along with four men. An effort 
was made to assess the consistency of individual performance in group 
interaction across groups as a basis for selecting categories for use in 
further analyses of the data. 

In order to determine which, if any, of the 24 measures from the 
group interaction situation would show retest reliability, 70 principals in 
the study repeated the problem on Thursday evening. Insofar as it was 
possible, within the limits imposed by assigning the 20 people at a test 
center to five-person groups, the principals were assigned to new groups 
on the second evening. The experimenter and observer were also 
changed. The problem used for the second group session was identical 
with the one used first except that the credentials described a group of 
three new candidates. 

For these 70 cases, correlations were computed between the Wednes- 
day and Thursday scores on each of 24 variables. These variables 
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included the frequency of interaction scores as tallied by the experi- 
menter, 17 categories from the observer’s Interaction Record,! and the 
six rating scores from the Group Report Form. 

Table 53 presents the means, standard deviations, and correlations 
between the two sets of scores for the 70 principals. Correlations that 
are starred in Table 53 are significant at or beyond the .05 level. Twelve 
categories met the criterion of showing consistent relationship between 
the two days. Many of the 12 categories that did not meet this criterion 
were used very infrequently (e.g., Reminds about Time or Makes Nega- 
tive Personal Remarks). Other categories may have failed to show con- 
sistency either because of the changes in group composition or because 
of unreliability in the scoring of the categories. The correlations in Table 
53 may be viewed as test-retest reliability estimates. Ten of these catego- 
ries were selected for further analysis. 


FACTOR ANALYSIS OF CATEGORY SCORES 


That the 10 group interaction scores do not measure entirely inde- 
pendent areas of performance in group situations is shown in Table 54, 
which presents the intercorrelations among the 10 scores from the group 
interaction situation. 

The highest correlations in Table 54 are, generally speaking, those 
in the lower right-hand quadrant of the table, which contain the inter- 
correlations of the ratings. A certain amount of halo probably accounts 
for the generally high correlations among the ratings. However, Friend- 
liness is generally unrelated to the other ratings and to the other vari- 
ables, possibly because of its low reliability. 

The intercorrelations of the experimenter’s and observer’s categories 
also tend to be positively correlated, but probably not because of halo. 
The highest correlations are those involving Frequency of Interaction. 
The score Raises New Issues correlates significantly with no other varia- 
ble; it is the lowest of the categories in reliability. 

That the correlations are not all due to halo or test form influences 
is shown by the correlations in the lower left part of the table—the cor- 
relations between ratings and observer records. The correlation of .50 
between Frequency of Interaction and Amount of Talking shows that 
the rating has some validity. Principals who make many comments tend 
to be rated as effective in presenting facts and as frequently trying to 


These scores were the sum of the frequency with which the behavior was 
tallied over the six five-minute periods. If a decision was reached before the 
sixth period an adjustment of the scores was made to compensate for the shorter 
period of time. 
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TABLE 56. Four factors from analysis of categories of group interaction 


Transformation Matrix Intercorrelations 
FACTOR A B C D FACTOR A B C D 
I alee 1 24s) 16 A 100 .61 .44 —.18 
II —.65 .89 —.27 —.07 B (Ot Orne Ome LO) 
Ill —.52 —.07 .93  .57 C 44 30 1.00 —.57 
IV 37 —.36 .00 ~~ .80 D —.18 .10 —.57 1.00 


influence others. Gives Positive Information and Suggests New Proce- 
dures both have relatively high correlations with some of the ratings. 

In order to achieve a better understanding of the relationships among 
the 10 group interaction scores, a factor analysis of the full matrix of in- 
tercorrelation was made. This analysis proceeded by estimating com- 
munalities as equal to the highest correlation in the row or column and 
obtaining the characteristic roots and vectors of the matrix. Inspection 
of the size of the 10 roots led to the decision to compute loadings for the 
four largest factors. Table 55 shows the unrotated orthogonal factor 
matrix and the rotated oblique matrix. Residual correlations (presented 
above the diagonal of Table 54) are small. 

Rotations from the orthogonal factor matrix to the oblique factor 
matrix were guided by the criteria of simple structure and were done by 
inspection of successive plots of the loadings of the category scores on 
pairs of factors. The transformation matrix and the inter-correlations 
among the oblique factors are given in Table 56. 

The four factors show a very mixed pattern of both positive and 
negative correlations, ranging from —.57 for Factor C with D to .61 
for A with B. These interrelationships will be examined after the Factors 
A through D have been identified. 

Only a tentative interpretation of the four factors in the group inter- 
action data will be attempted here. Subsequent examination of the rela- 
tionships between key categories in these factors and other variables in 
the study will add to the understanding of these factors. 

Factor A has loadings of +.25 on the following four interaction 
category scores: 


Attempts to Influence .64 
Amount of Talking 56 
Frequency of Interaction sae 
Friendliness —.34 


This factor involves a high level of interaction which is perceived 
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by the group members as attempting to persuade them to adopt a point 
of view. The behavior described by this factor cannot be called effective 
leadership, either from the viewpoint of the group members or the ob- 
servers. It is bipolar with negative loadings on Friendliness. This factor 
has been called Attempted Group Domination. 

Factor B has loadings above .25 on the following three category 
scores: 


Effective in Group Decision .67 
Presents Facts Effectively Ry? 
Friendliness 31 


This factor is related to perceived effectiveness by the group, but it 
is not significantly related to the observed behaviors of developing facts, 
suggesting procedures, and raising new issues. It is related to perceived 
friendliness and may reflect maintenance of good personal relationship 
in the group rather than direct effectiveness on the issues under discus- 
sion. It has been labeled Perceived Effectiveness. 

Factor C has loadings above .25 on four categories: 


Asks for Information 48 
Frequency of Interaction 42 
Suggests New Procedures ate 
Gives Positive Information 38 


Factor C seems to have three interrelated facets: a high rate of 
interaction, exchanging information (both giving and asking), and sug- 
gesting procedure. To the extent that the observer and experimenter 
were Observing the same behavior, high scores on asking and giving in- 
formation could not appear without high scores on frequency of inter- 
action also. Factor C might be characterized as observed participation 
through developing facts and suggesting procedure. The behavior that 
this factor covers is apparently not perceived as effective participation 
by group members. It has been entitled Observed Participation by De- 
veloping Facts. 

Factor D has loadings of above .25 on the categories of interaction 
which follow: 


Frequency of Interaction 38 
Suggests New Procedures ~ 34 
Asks for Information 30 
Raises New Issues .29 


This factor appears to be related to behavior which centers on in- 
termediate processes rather than the final decision which the group must 
make. Raises New Issues rather than Gives Positive Information dis- 
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tinguishes this from the preceding factor. Factor D has been called, 
tentatively, Observed Participation by Raising New Issues. 

It will be recalled that these four factors showed a complicated pat- 
tern of positive and negative intercorrelations (Table 56). Factors A 
and B were correlated positively (r= .61) and C and D negatively 
(r = —.57). Perceived Effectiveness and Attempted Group Domina- 
tion have a common core. This common element may be amount of 
attempted leadership, but the manner in which leadership is attempted 
seems to distinguish Perceived Effectiveness from Group Domination. 
Friendliness has positive loadings on Perceived Effectiveness but nega- 
tive loadings on Attempted Group Domination. Simply stated, if an at- 
tempt to lead is perceived as done in a friendly manner, the behavior 
tends to be seen as effective; otherwise, attempting to lead is equated 
with attempting to influence by domination. 

The negative relationship between Factors C and D suggests two 
perhaps antagonistic modes of group participation. Giving positive in- 
formation is supporting of the ongoing course of group action while 
raising new issues tends to be disruptive of the group procedure. These 
two modes of behavior appear to characterize different people. 


SPEECH PERFORMANCE 


The elementary school principal’s job characteristically involves 
speaking before others, both formally and informally. While some im- 
plications concerning the oral communication skill of the 232 Marion 
Smiths might be inferred from their in-basket performance and some of 
the ratings made by their superiors, direct evidence concerning their oral 
communication skill was obtained from the tape recording of the speech 
to the PTA. 


THE PTA SPEECHES 


As was described in Chapter 2, three tasks were given the principals 
on Tuesday afternoon. Two of these, the writing tasks, were assigned 
at the start of the afternoon’s activities. The third task was the prepara- 
tion and delivery of a 10-minute speech to the local PTA on the topic, 
“The Value of Education in America.” Rooms had been equipped to 
record the principals’ speeches on tape. Beginning at 2:00 P.M. and at 
intervals of 15 minutes thereafter, instruction cards were given to four 
principals at a time. Each card assigned the topic, stated that the princi- 
pal had 45 minutes to prepare his speech, and indicated that a staff mem- 
ber would escort him to a room where his speech would be recorded. 
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At the appointed time, a staff member escorted the principal to the 
room and set the stage by playing the role of the PTA program chairman 
announcing the speech. The following introduction was used for all 
subjects: 

Good afternoon. We are pleased to have our new principal Marion 


Smith with us today. He (she) will speak to us on the topic, “The Value of 
Education in America.” Marion Smith. 


After nine minutes, a signal was given the principals who were 
still speaking to indicate that they had one minute left. Except for this 
warning, the principals were left alone in the room during the delivery 
of the speeches. 


COLLECTION OF DATA 

Scoring categories were set up and the tape recordings of the princi- 
pals’ speeches were scored by a staff member of the Teachers College 
Speech Department.? The categories largely ignored the content of the 
speeches and attempted to get at variables in speaking skills. Ten cate- 
gories were used, nine of which were composed of from two to seven 
weighted indicators which defined the category. The categories, their 
component indicators, and the weights attached to each of these appear 
in Table 57. 

The weights shown in Table 57 were applied to a five-point rating 
made by the scorer for each indicator, and the sum became the score 
for the category. Rating five was defined as high and one as low. The 
score for a category was the weighted sum of the indicators. Few princi- 
pals utilized the full 10 minutes that they were given. Fifteen of the 232 
recordings were blank or completely unusable, thus reducing the total 
number of principals for whom speech data were available to 217. 


CONSISTENCY OF PERFORMANCE AND OF JUDGING 

Two procedures were used to estimate the reliability of speech 
scores. 

First, an over-all estimate of reliability was made by selecting 10 of 
the records at random for scoring by two additional judges. Both of the 
additional judges were members of the speech faculty of a university. 
Both had taught public speaking in high school and college. The total 
scores (obtained by summing the nine categories) given to each of the 
10 speeches by the principal scorer were correlated with the total scores 
given to the speeches by the additional scorers. For one of the additional 
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TABLE 57. Speech categories and their weighted components 


Speech Category 


Length of Speech (obtained di- 
rectly from tape recording, 
in minutes) 

Effectiveness of Introduction 
(Audience Rapport and Or- 
ganization) 


Organization of Body 


Effectiveness of Conclusion 


Proper Word Usage (Arrange- 
ment of Words) 


Clarity and Impressiveness (of 
Language) 


Voice Control 


Voice Interest 


Pronunciation 


Interest and Efficiency 


a 


A SRAHOTAHO SAMUS ADO SAD 


Scoring 
Weights 


Component Indicator 


. Gained attention and stimu- 


lated interest 


. Created good will and respect 
. Associated topic with audience 


and occasion 


. Provided background and defi- 


nitions 


. Stated central idea of speech 


Made purpose of speech clear 
Developed according to a plan 


Used relevant supporting material 


Contained ethical proof 
Contained emotional proof 
Contained logical proof 
Transitions 

Focused on central idea 
Indicated purpose of speech 
Provided climax 

Precise meanings 

Variety in sentences 
Acceptable grammar 
Avoided excessive nonfluencies 


. Intelligible and concrete 
. Varied word selection 
. Avoided trite phrases and loaded 


words 


a. Voice transmitted meaning 
b. Voice transmitted emotion and 


= 


ASA TARA SA 


sincerity 


. Projection 
. Pitch and intensity (range) 
. Variable and pleasant voice 


Rate and phrasing of delivery 
Proper form and use of sounds 
Used acceptable pronunciation 


. Relevant use of humor 
. Avoided apologies, excuses 


Made speech interesting to 
hearers 

Appropriate proportioning of 
time 


N vw 


NWR We WDNR WN RK RK RK DH WW WW i) 


NO — 


Pre WN WWNre dN 
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TABLE 58. Means, standard deviations, and estimated reliability of 10 
speech category scores (N = 217) 


Estimated 

Category Mean S.D. Reliability 
Length 6.96 Mg a0) — 
Introduction 29.44 6.81 .64 
Organization 29223 8.45 .90 
Conclusion 11.90 4.48 .85 
Word Usage 20.80 3.44 19 
Clarity 14.52 3.09 88 
Voice Control 9.17 2.49 .86 
Voice Interest 18.68 4.06 79 
Pronunciation 12572 2.69 .70 
Efficiency 14.99 3.40 .60 


judges the correlation was .78 and for the other .66. There appeared 
to be some consistency between judges in their appraisals of the speeches. 

Second, an estimate of the reliability (internal consistency) of the 
individual category scores was made by splitting the indicator within 
each category into two halves, each contributing as nearly as possible the 
same weight to the category score. For example, the three indicators for 
the category Clarity and Impressiveness were divided by placing the 
indicator “‘Intelligible and concrete” in one half (weight = 3) and the 
two indicators “Varied word selection” and “Avoided trite phrases and 
loaded words” in the other half (sum of weights = 3). These estimates 
of reliability, based on the correlations between the two halves and cor- 
rected by use of the Spearman-Brown formula, reflect the consistency 
with which the indicators within a category score were rated by the single 
rater. 

Table 58 presents the means and standard deviations for each of the 
10 speech categories and the estimate of the reliability of each of the 
Scores. 

No completely satisfactory measures of reliability of scoring the in- 
dividual speech categories are available. The correlation between total 
scores obtained by two judges is inadequate because (1) it reflects only 
rater agreement and (2) it makes use of a total score only (which is not 
used in the analysis). The internal consistency measures, based as they 
are on only one sample of behavior of each principal, cannot tell us about 
the consistency of the behavior of the principal but only the extent to 
which the rater agreed with himself. The estimates presented in Table 
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58 represent an upper limit on the reliability that might have been at- 
tained. 


FACTOR ANALYSIS OF CATEGORY SCORES 

Table 59 presents the matrix of intercorrelation among the 10 
speech categories. A factor analysis was made of the correlations in 
order to understand better the nature of interrelationships among the 
scores. 

Communalities were estimated as equal to the highest correlation 
in the row or column associated with the category. The roots and vectors 
of the complete correlation matrix were then computed. Inspection of 
the roots suggested retaining three factors. Table 60 shows the unrotated 
orthogonal factor matrix and the rotated oblique factor matrix. Residual 
correlations are listed above the diagonal in Table 59. 

Rotations from the orthogonal factor matrix to the oblique factor 
matrix were accomplished by preparing plots of pairs of factor loadings 
and were guided by criteria of simple structure. The final transforma- 
tion matrix and the intercorrelations among the three oblique factors 
are given in Table 61. These intercorrelations show that Factor B is 
relatively independent of the other factors, A and C, which show a 
substantial positive correlation of .62. 

Loadings on Factor A above .25 include 


Proper Word Usage .62 
Clarity and Impressiveness 54 
Effectiveness of Conclusion Be 
Organization of Body Bye) 
Pronunciation SY) 
Interest and Efficiency 36 
Effectiveness of Introduction Pa) 


Examination of the weighted scoring components of the first four 
categories above suggests that this factor is related to clarity of organ- 
ization and precision both in regard to the use of language in sentences 
and the over-all development of ideas. Principals high on this factor 
might well be regarded as effective speakers not because of their style 
of delivery, or the length of their speeches, but because of the precision 
and clarity of what they say. Thus, Factor A may be referred to as 
Precision, Clarity, and Organization. 

The loadings on Factor B are 

Length of Speech .66 


Interest and Efficiency .66 
Organization of Body 56 
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TABLE 60. Factor matrices for 10 speech category scores 


Unrotated Orthogonal Rotated Oblique 
Category Factor Matrix Factor Matrix h2 
I II Ill A B C 
Length .29 61 18 —.05 .66 05 .48 
Introduction .76 .18 atl eel .43 ip da) .62 
Organization .83 28 —.16 ie 56 —.01 19 
Conclusion .63 12 —.26 3 35 —.10 .48 
Word Usage 76 —.31 —.26 62 —.01 7 io 
Clarity 78 —.24 —.16 54 .06 ais) .69 
Voice Control 74 —.20 34 .08 .06 58 eLO 
Voice Interest 65 —.30 45 —.05 —.07 .68 71 
Pronunciation 58 —31 —.10 39 —.08 NU) 44 
Efficiency .79 .40 .00 36 .66 .09 .79 
Effectiveness of Introduction .43 
Effectiveness of Conclusion ah 


Factor B is unrelated to the other two factors and is most clearly 
characterized by Length of Speech. Examination of the weighted com- 
ponent of the other categories which load on Factor B suggest that this 
factor is related to the effective use of the allocated time. The speaker 
organizes his speech so that he may use his time to develop his topics 
effectively. Factor B may be referred to as Effective Use of Time. 

Loadings on the third factor are 


Voice Interest .68 
Voice Control 58 
Effectiveness of Introduction Das 


Factor C may be referred to as Voice Control and Delivery, since 
it is related most closely to control of voice in such a manner that the 
meaning intended, sincerity, and enthusiasm are conveyed in the speech. 


TABLE 61. Final transformation matrix and correlations among factors 
from analysis of 10 speech category scores 


Transformation Matrix Intercorrelations 
FACTOR A B G FACTOR A B G 
I 49 aa 27. A 1.00 .00 .62 
II —.06 93 —.32 B .0O ~=—1.00 19 
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RELATIONSHIPS WITH OTHER VARIABLES OF THE STUDY 


Following the pattern of the preceding chapter, in this section the 
relationship between a large number of other variables in the study and 
two selected scores from the 10 group interaction scores and two from 
the 10 speech scores will be examined in detail. Attention will be fo- 
cused on the group interaction categories, Amount of Talking and Pre- 
sents Facts Effectively, and on the speech category scores, Word Usage 
and Length of Speech.’ 

Table 62 presents the correlations of 32 in-basket category scores 
with the four measures. 

There are a number of significant relationships shown in Table 62. 
(Correlations of +.17 or larger are significant beyond the .01 level.) 
The relationships of both group interaction scores with in-basket cate- 
gories have a somewhat similar pattern and for the most part involve 
categories that are concerned with communication (exchanging of in- 
formation or discussing with others). 

The most striking finding in Table 62 is that relatively high correla- 
tions are found in the Word Usage column. The pattern of correlations 
is somewhat similar to that for the two interaction categories; but it is 
surprising to find correlations as high as .35 between a rating of a tape- 
recorded speech and scores based on responses to in-basket items. The 
explanation may be that Word Usage reflects the general educational 
and intellectual level of the speaker, since the highest correlations are 
with in-basket categories which are related to mental abilities. 

Table 63 presents the correlations of the four scores, Amount of 
Talking, Presents Facts Effectively, Word Usage, and Length of Speech, 
with the ability and professional knowledge test scores. 

Both of the group interaction scores show positive relationships 
with three of the tests of professional and general knowledge and with 
the background achievement test score (r’s range from .20 to .31). In 
addition, Amount of Talking is related to reasoning, both deductive 
(r = .21) and inductive (r = .19), and to fluency, especially ideational 
HUCNCVa(Te——a 2) 

Length of Speech has low, although usually positive, correlations 
with ability measures, the highest correlation being .20. Word Usage, 


* The two group interaction categories were selected on the basis of results re- 
ported in Appendix E because of their high loadings in this over-all analysis. 
Speech scores were not included in the 120 variable analysis of Appendix E 
because of the irregularity that would be introduced by the 15 cases for which no 
speech data were available. The two speech categories selected here have highest 
loadings on Factors A and B. 
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on the other hand, has fairly high correlations with a number of ability 
measures, especially verbal knowledge (r = .40) and the tests of pro- 
fessional knowledge (r = .45 and .41); this result tends to corroborate 
the hypothesis that in rating speeches on Word Usage, the rater was 
responding to the general educational and intellectual level of the 
speaker. Also related to Word Usage are ability to reason (r = .18, 
.25, and .21), facility in the use of symbolic material [subtraction and 
multiplication (r = .28), and addition (r = .25)] and fluency (r = .22, 
14, .16, and .28). 

Table 64 presents the correlation of the group interaction scores 
and the speech scores with basic personality factors, background orien- 
tation, and interest scores. 

In the group interaction situation, differences in Amount of Talking 
appear to reflect differences in personality of the principals. Those 
principals who impressed their associates in the group interaction situa- 
tion with their amount of talking described themselves on the personality 
questionnaire as adventurous (r= .28), dominant (r= .24), and 
friendly (r = .20). Their interest appeared to be somewhat more like 
the interests of public administrators (r= .17), city school superin- 
tendents (r = .17), and lawyers (r = .17). Presents Facts Effectively 
was unrelated to any of the variables except the lawyer key on the 
Strong Vocational Interest Blank; principals with interests similar to 
lawyers were rated as effective in presenting facts (r = .20). 

Length of Speech made by principals is unrelated to the personality 
factors but shows small relationships to interest in the area of public 
administration (r = .20) and psychologist (r=.17). Arrangement 
and proper use of words is generally unrelated to the personality meas- 
ures; it relates negatively with the interest score for policeman (r = 
—.35), and positively with interest scores for lawyer (r = .25), psy- 
chologist (r = .21), and city school superintendent (r = .19). There 
is also a small indication that proper use of words in speech is positively 
related to sensitivity to pupil educational needs (r = .26). 

Table 65 presents the correlations of the two group interaction 
scores and the two speech scores with the instructional awareness cate- 
gories and job performance values. 

With minor exceptions, the only important relationships in Table 
65 involve the speech category Word Usage. Most of the instructional 
awareness categories and three of the job performance values are sig- 
nificantly correlated with this speech score. Although this speech cate- 
gory was based on an oral performance and the instructional concerns 
were based on written work, the two undoubtedly have a common re- 
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quirement of verbal facility, fluency, and other cognitive abilities. This 
explanation for these correlations is clearly supported by data previ- 
ously presented and discussed (see Table 48, Chapter 9, and Table 63 
in this chapter). 

Table 66 presents the correlations of the four scores with eight 
group interaction category scores and five biographical variables. The 
correlations in the upper left portion of the table are also shown in 
Table 54 and were discussed previously. 

The two speech variables are for the most part unrelated to the 
group interaction scores; but Length of Speech- correlates with Fre- 
quency of Interaction (r= .20) and Suggests New Procedures (r = 
ae 

The biographical variables are unrelated to either of the group 
interaction scores, but some interesting relationships with speech scores 
are found. There is a definite tendency for women to be rated higher 
on Word Usage (r= .35), but men tend to give longer speeches 
(r = .24). 

Total experience is positively associated with the Word Usage rat- 
ing (r = .18), but amount of academic training does not correlate with 
Word Usage. Years of academic training does, however, relate to Length 
of Speech to a slight extent (r = .20). 

Table 67 presents the correlations of the two group interaction 
scores and the two speech scores with performance evaluations. 

Evaluations of the principals’ performance made by the in-basket 
test scorers and the staff members show definite positive correlation 
with each of the four scores. Since staff members observed the princi- 
pals in the group interaction problem, it is understandable that their 
ratings should have high correlations with the group interaction vari- 
ables. The in-basket test scorers, however, had no direct association 
with the principals or with any materials related to the group interac- 
tion problem or the speech. The positive association between their 
impression of the principals and the principals’ scores on these four 
categories may best be accounted for in terms of an element of verbal 
ability, skill, or facility which was common to in-basket work and the 
group interaction and speech tasks. The highest correlation of scorers’ 
impressions is with Word Usage (r = .40). 

Teachers’ impressions show small and usually positive associations 
with the four variables. The generally small relationship exhibited is of 
interest because the group interaction situation provides tasks more like 
the ones in which teachers and principals are normally involved to- 
gether than other tasks of the test week. 
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The significant correlation with the superiors’ evaluations all in- 
volve the categories Presents Facts Effectively and Word Usage. These 
two categories are positively related to the superiors’ ratings on the items 
Knowledge of Administration (r = .29 and .20), Knowledge of Teach- 
ing (r= .22 and .27), Understanding (r = .28 and .17), and Oral 
Communication (r = .28 and .22). These relationships point to the 
importance superiors attach to communication skill in forming the im- 
pression of the principals. 


Chapter 11 


SUBJECTIVE EVALUATIONS 
OF PERFORMANCE 


THE MOST USUAL EVALUATION OF THE PERFORMANCE OF AN ADMINIS- 
trator is an over-all subjective judgment. The progress of an elementary 
school principal—his promotion, dismissal, transfer, and salary—de- 
pends primarily on the opinions of his superiors. 

Special subjective evaluations of the performance in their home 
schools of the elementary school principals in the study were made by 
their superiors and their teachers. These evaluations were usually made 
prior to the test week. In addition, subjective evaluations were made 
by in-basket test scorers and by members of the research staff. This 
data provides an opportunity to investigate the question of which char- 
acteristics of a principal’s performance are viewed favorably by his 
superiors, by his teachers, by the in-basket test scorers, and by mem- 
bers of the research staff. 

This chapter will stress achieving a greater understanding of the 
subjective evaluations that are made about the principals’ performance. 
None of the evaluations is assumed to be a criterion and the correlations 
with these evaluations are not regarded as validity coefficients. The 
object is to learn more about the nature of the judging process and 
about the attitudes and values of those who make the judgments. The 
correlations of subjective judgments with other scores will be of interest 
because of the information they give about the characteristics of princi- 
pals who are perceived as good by members of a class of judges. 
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DESCRIPTION OF EVALUATIVE MEASURES 


A number of evaluative measures were used, including ratings of, 
in-basket scorers and staff members, and teacher and superior ratings. 


RATINGS OF IN-BASKET SCORERS 

These measures have been discussed in Chapter 6. After each in- 
basket scorer had completed scoring her particular half of an in-basket 
test, she was asked to make three judgments about the performance of 
the principal. The one of greatest interest required her to circle a num- 
ber on a seven-point rating scale to indicate her answer to the following 
question: On the basis of what you know about the subject, how well 
do you think he would perform as the principal of Whitman School (or 
as the executive officer of the Northeastern Division of the Bureau of 
Business)? The high end of the scale (7) was defined as well and the 
low end (1) as poorly. 

Eight judgments were made about each principal, one by the scorer 
of the odd-numbered items for each of the four in-baskets, and one by 
the scorer of the even-numbered items for each of the four in-baskets. A 
total score, the sum of the eight ratings, was obtained for each principal. 
The mean total score for all 232 principals was 30.2, with a standard 
deviation of 5.0. Dividing the mean by 8 gives 3.8, the average rating 
assigned the principals by the scorers, which is a little below the middle 
of the seven-point rating scale. 

The reliability of the scorers’ rating was computed by correlating 
the sum of the ratings made by the scorers of the odd-numbered items 
with the sum of those made by scorers of the even-numbered items and 
then applying the Spearman-Brown formula to estimate the reliability 
for all eight ratings. The reliability was found to be .72. This reliability 
reflects the amount of consistency of performance of the principals as 
well as the amount of agreement between raters, since no two raters 
scored the same in-basket responses. 

After scoring her in-basket responses the scorer also completed an 
adjective Check List to describe each principal. Her task was to check 
the one of each pair of adjectives that best described his behavior. There 
were 21 pairs of adjectives, such as Friendly—Aloof, Slipshod—Pains- 
taking, and Courteous—Rude. The principal’s score for each adjective- 
pair was the number of times the adjective in the left-hand position was 
checked by the eight scorers. 

A reliability estimate for each adjective-pair was determined by 
correlating the score obtained from the four scorers of odd-numbered 
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TABLE 68. Means, standard deviations, and reliabilities of adjective-pairs 


Adjective-Pair Mean S.D. Reliability 
Urbane—Rough 4.53 1.85 .68 
Forceful—Tentative 4.94 1.78 Syl 
Slipshod—Painstaking 2.63 hw 45 
Cold-hearted—Genial 1.00 1.03 44 
Resourceful—Notionless 3.54 5 53 
Logical—Intuitive 6.13 i135 47 
Tactful—Tactless 6.45 1.29 45 
Wordy—Terse Shthe) 1.90 58 
Courteous—Rude 7.00 1.14 47 
Witty—Humorless a7 1.34 56 


items with that obtained from the four scorers of even-numbered items 
and then applying the Spearman-Brown formula. Ten of the 21 ad- 
jective-pairs were chosen, on the basis of their reliabilities, for use in 
the subsequent analysis. The reliabilities of these adjective-pairs are 
shown in Table 68, along with their means and standard deviations. 
The pairs not shown in the table had reliabilities below .42. The inter- 
correlations of the 10 pairs used in the analysis are shown in Table 69, 
along with their correlations with the in-basket scorers’ over-all rating 
of the principal, many of which are high. It would appear that checking 
Urbane, Forceful, Painstaking, and Resourceful are almost equivalent to 
rating the person as a good principal of Whitman School. The intercor- 
relations of these four adjective-pairs are very high as compared with 
their reliabilities. The adjectives Cold-hearted, Tactful, and Courteous 
apparently represent personal characteristics that tend less to be equated 
with good performance as a principal. 


RATINGS OF STAFF MEMBERS 

At least two research staff members were present at each of the 
test centers. During the week it was their responsibility to supervise all 
activities of the center: administer the tests, introduce the speakers at 
the PTA, serve as experimenter or observer for the interaction problem, 
and so on. The staff members had meals with the subjects and associ- 
ated with them informally during the evening hours. They thus came to 
know the principals mostly through informal observations; only in the 
interaction problem did they have a formal opportunity to observe the 
work of the principals. 

At the end of the week, all staff members evaluated the principals. 
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The Staff Evaluation Form involved a nominating technique. The 
evaluation was made in response to the following question: “If you 
were requested to select a principal for Whitman School on the basis 
of what you now know about each one, whom would you choose?” 
The five best and the five poorest were nominated independently, in 
order of preference, by each staff member. Nominations were also made 
for popularity and likeableness; but only the over-all impression was 
used in the analysis. 

The average nomination value used in the analysis was obtained by 
using the following set of numerical values to correspond to the nom- 
inations: 

First choice 5 
Second choice 4 
Third choice 3 
Fourth choice 2 
Fifth choice 1 
No nomination 0 
Fifth from last choice —1 
Fourth from last choice —2 
Third from last choice —3 
Next to last choice ——4 
Last choice —S5 


The number of staff members making nominations was usually two; but 
at some centers, where more staff members and observers were present, 
more nominations were obtained, the largest at one center being six. 

After the average nomination value for each principal was obtained, 
the averages were converted to a 10-point scale using the following 
conversion: 


4.00 and above 9 
3.00to 3.99 8 
2.00to 2.99 7 
1.00to 1.99 6 

0 to 0.99 5 
—1.00 to —0.01 4 
—2.00 to —1.0 3 
—3.00 to —2.01 2 
—4.00 to —3.01 1 
—5.00 to —4.01 0 


A principal who received no nominations from anyone would thus be as- 
signed a score of 5. ; 

In order to estimate the reliability of the staff rating, the nomina- 
tions made by the two regular staff members—the administrator (the 
person in charge of the test center) and his chief assistant—were used. 
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The administrator was the same person at most centers, but the chief 
assistant assignment was filled by a number of different persons. The 
judgments made by these two raters were correlated and corrected for 
double length to give an estimate of the reliability for a composite based 
on two judges. This reliability estimate was found to be .60. Since the 
composite used in the study was based on at least two and often on 
more than two judges, its reliability might be expected to be a bit higher 
than .60. 


TEACHERS’ JUDGMENTS 


Each teacher in the schools served by the 232 principals filled out 
two forms describing the behavior of his principal. In all, more than 
7,000 teachers filled out these forms. One form was called the Teacher 
Reaction Form and the other the Principal Behavior Description Ques- 
tionnaire. 

Teacher Reaction Form. This form was developed by Griffiths.? 
It contains 20 statements about the behavior of a principal, each of 
which is answered by checking always, often, occasionally, seldom, or 
never. Since all the statements are favorable, the always response is 
given the most credit. The numerical values used in scoring are 4, 
3, 2, 1, and 0, respectively, for the adverbs always to never. The total 
score is the sum of the values corresponding to the answers checked. 
The fact that all the items are stated in a favorable direction presumably 
makes the form susceptible to a response bias of acquiescence. The 
probable effect of such bias would be to move the mean toward the 
always end of the scale. 

The statements cover a wide range of behaviors, as shown by this 
sample of the items: 


. He is very courteous and friendly. 

. He sets reasonable standards. 

. He respects others’ opinions. 

. He displays initiative. 

. He is solicitous concerning his new teachers. 
. He is a very hard worker. 

. He is an effective public speaker. 


AUDNMNHRWN 


At least two-thirds of the 20 items can be interpreted as reflecting con- 
sideration for teachers; items 1, 2, 3, and 5 above are examples. 


* Daniel E. Griffiths, An Evaluation of the Leadership of the School Superin- 
tendent. Doctor’s Thesis, Yale University, 1952. (Unpublished. A digest was 
published by the CPEA-MAR Center of Teachers College, Columbia University, 
1952.) 
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The mean score on the Teacher Reaction Form was 64.2, which 
means that on the average items were rated often. The standard devia- 
tion was 7.1. The reliability of the score on the Teacher Reaction Form 
was computed by dividing the teachers under each principal into two 
random groups, a and b. The correlation between means of the a group 
with means of the b group, corrected for double length, was used as the 
reliability estimate. This coefficient was .82. 

Principal Behavior Description Questionnaire. This instrument is 
essentially the same as the Leader Behavior Description Questionnaire, 
which is a product of the Ohio State Leadership Studies.2, The word 
Leader in the title was changed to Principal and the word staff in the 
items was changed to faculty or faculty members; otherwise the two 
instruments are identical. The instructions used were those that re- 
quired respondents to describe the principal’s behavior on the job. 

The items are statements describing the principal’s behavior. Each 
is to be answered always, often, occasionally, seldom, or never. The 
Principal Behavior Description Questionnaire contains 40 items, 10 that 
were not scored. Fifteen items contribute to a measure of Initiating 
Structure and 15 to a measure of Consideration. Initiating Structure has 
to do with behavior on the part of the principal which makes clear the 
organization, responsibilities, and behavioral consistencies of members 
of the group. Some of the items are: 


He makes his attitudes clear to the faculty. 

He criticizes poor work. 

He emphasizes the meeting of deadlines. 

He lets faculty members know what is expected of them. 


All but one of the 15 items are keyed in the always direction. 

Consideration, as the term implies, reflects behavior of the principal 
that shows concern for the happiness and welfare of his faculty. Sample 
items are: 


He does personal favors for faculty members. 

He is easy to understand. 

He refuses to explain his actions (scored negatively). 
He is friendly and approachable. 


Four of the 15 Consideration items are scored negatively. 

In scoring the Questionnaire, the choices are given values of 4 to 0, 
just as in the Teacher Reaction Form (or 0 to 4 in the case of the nega- 
tively stated items). The mean score for Initiating Structure was 42.4 


? Andrew W. Halpin, The Leadership Behavior of School Superintendents 
(Columbus: College of Education, The Ohio State University, 1956). 
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with a standard deviation of 4.6. For Consideration the mean and 
sigma were 45.6 and 5.4, respectively. The adverb often was typi- 
cally chosen to describe considerate behavior, while for Initiating Struc- 
ture the mean was at a point a little below often. 

The Principal Behavior Description Questionnaire score for a given 
principal is the mean of the scores obtained from the forms filled in by 
all his teachers. To estimate the reliability of the Initiating Structure 
and Consideration scores, the teachers under each principal were di- 
vided at random into two subgroups, and mean scores were obtained 
from each subgroup. The reliability coefficient is the correlation between 
the scores obtained from these subgroups, corrected for double length. 
The reliability was .83 for both the Consideration and Initiating Struc- 
ture scores. 


RATINGS OF SUPERIORS 


A form called Performance Ratings for School Principals was pre- 
pared for use by the superiors of the principals. It asked for evaluation 
of the principal on 12 characteristics and, in addition, for an Over-all 
General Impression. The form of the instrument is illustrated by one 
of the items: 


ABILITY TO GET ALONG WITH PARENTS 


[_] Frequently disagreeable; often shows lack of tact; fails to get along 
[_] Shows lack of skill in human relations; should get along better 

[] Usually gets along with no more than minor conflicts 

[_] Gets along well; is well liked 

[_] Very well liked; his friendship and advice are sought 


[_] I cannot make a fair evaluation. 


The 12 rating items are as follows: 


Interest in Work 

Capacity to Stick to a Job in Spite of Difficulty 
Ability to Get Along with Teachers 

Ability to Get Along with Parents 

Ability to Get Along with Superiors 

Knowledge of Administrative Practices and Procedures 
Knowledge of Teaching Methods and Techniques 
Rapport with School Children 

Written Communication Skill 

Understanding Written Communication 

Oral Communication Skill (Formal) 

Oral Communication Skill (Informal) 
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The thirteenth and final item in the rating form is as follows: 


OVER-ALL GENERAL IMPRESSION 
[_] A poor performer, the kind you wish you didn’t have 
[_] Not so good as most; wouldn’t want many like this 
[_] Satisfactory but room for improvement 
[_] A good performer, but there are better 
[_] One of the very best; you wish there were more like this 


[] I cannot make a fair evaluation. 


In some of the items, the “favorable” end of the scale was placed 
first, and in others, like the two illustrated, the “favorable” end was last. 

On the cover page of the rating form the evaluator was asked the 
following question: “How confident are you about your ability to judge 
and evaluate his work?” ‘This was to be answered by checking very 
confident, confident, or not confident. 

In small school districts the raters were usually superintendents and 
assistant superintendents. In large school systems they were supervisors 
and assistant superintendents. It was clearly stated on the form that the 
ratings were for research purposes only and would not be revealed to 
the principals concerned. The mean number of raters per principal was 
2.74. 

‘The obvious method of scoring the form is to assign numerical val- 
ues to the ratings by each superior and to obtain for each item the 
mean of these values. It might be desirable, however, to weight the 
ratings on the basis of the amount of confidence expressed by the rater 
in his ability to make the judgment. Before deciding on the scoring 
method, a comparison was made of the reliabilities of judgments made 
by all judges as compared with only the “very confident” judges. 

The number of judges varied from principal to principal, and still 
more variation in number of ratings resulted from occasional use of the 
sixth box, “I cannot make a fair evaluation.” This latter rating made it 
necessary to omit that item from any further consideration. It was there- 
fore impossible to apply a straightforward correlational method for es- 
timating reliability. The method chosen was to use the intra-class cor- 
relation. Through the use of values of 1 to 5 for the five positions on 
the rating item, intra-class correlations were computed for each rating 
item. The intra-class correlation is equivalent to the average of the 
correlations between all possible pairs of raters. Since in fact there was 
more than one pair of raters, it is appropriate to estimate what the reli- 
ability would be for the larger number of raters by means of the Spear- 
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TABLE 70. Means, standard deviations, and intra-class correlations of su- 
periors’ ratings 


Intra- Estimated 
Rating Item Mean Mean* §S.D. Class Reliability 
Cor- for Three 

relation Raters 


Interest in Work AD 3 A: 2 Sia Ok Bye rit 
Sticking to a Job 4.04 4.05 .67 3) Tay 
Getting Along with Teachers SEPA ou aioe | BING, 56 19 
Getting Along with Parents BIS 2 LO Ss Meee 45 hl 
Getting Along with Superiors 5.88 3 OO nme .60 82 
Knowledge of Administration 3.0256 wo Ole 4 58 81 
Knowledge of Teaching 325 0.g 10259 ee .63 84 
Rapport with Children A 2342 OL 34 61 
Written Communication 3.) 0 a) OOS 0 ie fs 
Understanding 3 OD ae >: 0) GammenTS eye) this 
Oral Communication (Formal) 3:54 5 3:50'"" *.66 23 O19. 
Oral Communication (Informal) 3.58 3.60  .62 3 Shih 
Over-all Impression 3:3 0593.50. ue oS 74 .89 


* Based on ratings weighted by confidence levels. 


man-Brown prophesy formula. With 3 as an approximation of the mean 
number of raters, the corrected reliabilities as estimated by this method 
are shown in Table 70, along with the means and standard deviations. 
(The scoring values were assigned in such a way as to give the favorable 
end of each rating scale the numerical value of 5.) The reliability of 
ratings is slightly elevated by the approximation just referred to. The 
reliabilities would also be spuriously increased by any discussions 
among the raters as to the merits of a particular principal. The instruc- 
tions were to avoid such discussion prior to the ratings, but a certain 
amount of discussion must have taken place in the normal work of the 
superiors. At any rate, the estimates indicate that the judgments are 
reasonably reliable in the sense that judges tend to agree with one an- 
other. It is interesting to note that the lowest reliability is for the item 
Rapport with Children. 

The reliability of the over-all evaluation supplied by those judges 
who stated that they were very confident of their ability to judge the 
principal’s work was computed in the manner just described. For these 
confident judges, the intra-class correlation turned out to be .85, as 
compared with .74 for all judges. This higher reliability for the con- 
fident judges led to the decision to adopt a revised scoring system, which 
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weighted more heavily the judgments of superiors who expressed con- 
fidence in their judgments. 

The modified scoring system involved multiplying each rating by a 
number corresponding to the confidence level of the judge, and divid- 
ing the sum of the weighted ratings by the sum of the weights. The 
weights used were 1 for Not Confident, 2 for Confident, and 3 for 
Very Confident. Thus if a principal were rated 3, 2, and 2 by three su- 
periors, with confidence levels of 1, 2, and 2, respectively, his score 
would be 2.2. Without the weighting the score would be slightly higher, 
2.33, because of the greater influence of the low-confidence rating of 3. 
As can be seen in Table 70, the weighting had slight influence on the 
means. No reliabilities based on the weighted scores were computed, 
but one can be reasonably confident that these reliabilities would be at 
least as high as those shown in Table 70. 

The intercorrelations of the ratings are shown in Table 71. One 
would expect the correlations to be high because of the familiar “halo” 
effect. Many of the correlations are in the .70’s, but there are enough 
correlations in the .20’s and .30’s to suggest that the raters have suc- 
ceeded in differentiating various aspects of excellence in the work of the 
principals. Because of the importance of superiors’ ratings in real-life 
administrative situations and because of their importance in clarifying 
the behaviors observed in Whitman School, it was decided to factor the 
matrix of intercorrelations of superiors’ ratings. 

The analysis was performed by computing the characteristic roots 
and vectors, using the highest correlation in each row or column as the 
estimate of the communality. Table 72 shows the roots that exceed the 


TABLE 72. Characteristic roots exceeding value of largest negative root 


Order Roots Decrease 
I 6.92 

II 1.36 5.56 
Hil 50) 86 
IV 2 18 

Vv 26 06 
VI 185) 08 
XIII —.14 (largest negative root) 


Total 9.34 
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TABLE 73. Orthogonal factor matrix 


Rating Item 


Interest in Work 

Sticking to a Job 

Getting Along with Teachers 
Getting Along with Parents 
Getting Along with Superiors 
Knowledge of Administration 
Knowledge of Teaching 
Rapport with Children 

Written Communication 
Understanding 

Oral Communication (Formal) 
Oral Communication (Informal) 
Over-all Impression 


Factor 

I II Il IV V 

.80 .04 29 .22 —.10 
77 —.01 .26 .20 24 
.64 —.55 —.18 —.01 01 
.69 —.51 —.10 —.01 11 
73 —.37 .09 —.23 05 
.76 20 15 —.02 14 
dst iy 18 —.09 —.31 
50 —.45 —.07 12 —.25 
.68 34 —.10 —.24 .0O0 
.80 21 —.05 —.18 .06 
.69 37 —.29 21 .0O 
14 22 —.37 Hal .O1 
.90 —.02 .0O7 —.06 —.04 


Zo) 


largest negative root. It was decided to retain five factors. The residual 
correlations are shown above the diagonal in Table 71, and Table 73 
presents the unrotated orthogonal factor matrix. 

Graphic rotational methods were employed to produce an oblique 
factor matrix showing simple structure. The final transformation matrix 
is shown in Table 74 and the oblique factor matrix that it produced is 
shown in Table 75. In the following discussion of the factors, all factor 
loadings of .25 or higher will be considered. 


Factor A has loadings of .25 or higher on the following items: 


Ability to Get Along with Teachers 
Ability to Get Along with Parents 
Rapport with School Children 
Ability to Get Along with Superiors 
Over-all General Impression 


.69 
iG 
56 
ae 
29 


This factor obviously reflects superiors’ opinions about ability to get 


TABLE 74. Final transformation matrix 


A B 
I .26 .06 
II —.85 —.09 
Il —.32 U3 
IV —.23 Ape 


Vv —.22 —.99 


C D 

16 12 
.08 ali, 
.69 —.78 
54 58 
44 08 
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TABLE 75. Oblique factor matrix 


Factor 
Rating Item — 
A B C D E 

Interest in Work .06 ie) 41 —.01 .O2 
Sticking to a Job .03 —.18 fay 02, .02 
Getting Along with Teachers .69 .07 —.07 He .O1 
Getting Along with Parents 62 —.02 .04 .08 .04 
Getting Along with Superiors ny .02 05 —.17 31 
Knowledge of Administration —-.07 —.11 30 02 26 
Knowledge of Teaching .O1 33 08 —.09 31 
Rapport with Children 56 32 —.04 .09 —.12 
Written Communication — .03 .00 —.06 .O7 45 
Understanding .08 —.04 05 AU! 29 
Oral Communication (Formal) —-.08 O01 .O5 .49 .O1 
Oral Communication (Informal) .09 01 —.05 .48 .O7 


Over-all Impression Jee) .O9 AN br) .O1 .26 


along with others, and we have named the factor Judgment of Ability to 
Work with Others. The superiors’ over-all impression of the principal 
has a small positive loading on this factor. 

Factor B has loadings of .25 or higher on only two items: 


Knowledge of Teaching Methods and 
Techniques a3 
Rapport with School Children 32 


We have named this factor Judgment of Skill with Children. 
Factor C has loadings of .25 or more on three items: 


Capacity to Stick to a Job in 


Spite of Difficulty nays 
Interest in Work 41 
Knowledge of Administrative Practices 

and Procedures 30 


Because of the nature of the first two of the above items, which have the 
highest loadings, this factor is named Judgment of Motivation for Ad- 
ministrative Work. 

Factor D is very well defined, with two high loadings and no others 
higher than —.17. 


Oral Communication Skill (Formal) 49 
Oral Communication Skill (Informal) 48 


The factor is called Judgment of Speaking Ability. 


SUBJECTIVE EVALUATIONS OF PERFORMANCE 233 


TABLE 76. Intercorrelations of factors 


A B C D E 
A 1.00 .03 47 Pall .28 
B .03 1.00 54 .46 AT 
C 47 54 1.00 .66 71 
D ae .46 .66 1.00 18 
E .28 47 71 78 1.00 


Factor E has loadings of .25 or greater on six items. 


Written Communication Skill 45 
Understanding Written Communication .39 
Ability to Get Along with Superiors 31 
Knowledge of Teaching Methods and 

Techniques 31 
Knowledge of Administrative Practices 

and Procedures .26 
Over-all General Impression 26 


This factor is named Judgment of General Professional Skill. Since the 
highest loading of the over-all rating is on this factor and since there is a 
high loading on Ability to Get Along with Superiors, it appears that the 
general evaluation of a principal by his superior is particularly likely to 
reflect skills in reading and writing (as well as Judgment of Ability to 
Work with Others, Factor A). 

The intercorrelations of the factors are shown in Table 76. In view 
of the amount of halo typically found in ratings, one would expect the 
correlations to be high. Factors D and E, both of which have to do with 
communication skills, correlate .78. But Factor A, Judgment of Ability 
to Work with Others, correlates only .27 and .28 with the two communi- 
cation factors, and, interestingly enough, it correlates only .03 with 
Factor B, Judgment of Skill with Children. 

The superiors’ ratings, then, can be thought of in terms of five in- 
stead of a dozen dimensions. When the superiors’ ratings are considered 
characteristics of the principals themselves, it will be more convenient 
to make use of the more parsimonious way of viewing the superiors’ 
evaluations. 


INTERRELATIONSHIPS OF SUBJECTIVE EVALUATIONS 


Table 77 shows the intercorrelations of the major over-all subjective 
evaluations, including the two scores from the Principal Behavior De- 
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TABLE 77.  Intercorrelations of over-all subjective evaluations 


Evaluation 1 fi a o 5 6 
Superiors’ General Impression 16+. \.22), #32 6G 18 
In-basket Scorers’ Rating 16 32) ,08 0 403 == 04 
Staff Members’ Rating O2 2 17 ey .08 
Teachers’ Reaction .26 (OS by .88 47 
Consideration 14 035) O09 taeGs 16 
Initiating Structure 18> .—03. |. .08 4). 47a? 


scription Questionnaire. There is a very high correlation between the 
Teacher Reaction Form score and the Consideration score from the 
Principal Behavior Description Questionnaire (.88); the Teacher Re- 
action Form score also correlates .47 with the Initiating Structure score 
from the same questionnaire. The Teacher Reaction Form and the 
Principal Behavior Description Questionnaire are inventories of quite 
similar item types and similar content, both filled out by the same teach- 
ers. There is apparently a good deal of overlap, especially with the Con- 
sideration score. 

Except for the fact that teachers tend to agree with themselves, there 
is rather little evidence of agreement to be found in the table. The high- 
est correlation of the superiors’ over-all judgment is .26 with the Teacher 
Reaction Form. Although the content of the items in the Teacher Re- 
action Form imposes enough limitation on the evaluation that it can 
hardly be called an over-all rating, nevertheless there is little doubt that 
it reflects the general impressions the teachers have formed about their 
principal. In spite of the fact that both teachers and superiors observed 
the same principal over a relatively long period of time in the same gen- 
eral setting, they show little agreement in their evaluations. There is 
still less agreement with the ratings made by in-basket scorers and by 
staff members. 

The in-basket scorers tend to agree with staff members in their over- 
all rating of principals (r = .32). This is in spite of the fact that scorers 
and staff members observed completely different aspects of the princi- 
pals’ behavior. The staff members’ knowledge of principals was based 
largely on informal acquaintance; the only work of the principals they 
observed was in the group interaction situation. The in-basket scorers, 
on the other hand, never saw the principals, but examined in consider- 
able detail their in-basket responses. 

All other relationships are low. Clearly, the subjective evaluations 
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do not constitute a single criterion of the performance of the principals, 
although they may perhaps be thought of as several criteria that reflect 
different aspects of administrative behavior. It is preferable to think 
of the ratings as reflecting several points of view as to what is good ad- 
ministration. 

The remainder of this chapter will attempt to provide answers to 
the following question: What kind of principal was viewed as good (1) 
by the superiors, (2) by the teachers, (3) by the staff members, and 
(4) by the in-basket scorers? 


RELATIONSHIPS WITH SPECIFIC SUPERIOR RATING ITEMS 

Table 78 presents the correlations of the six over-all evaluations 
with the more detailed items of the ratings made by superiors and in- 
basket scorers. The upper part of the table is based on the 12 rating 
items in the superiors’ rating form, Performance Ratings for School 
Principals, and the lower part on the Scorers’ Check List. This table 
is relevant to the question of what characteristics are valued by two 
kinds of evaluators. 

The first 12 entries in the first column of Table 78 are the correla- 
tions of the superiors’ general impression with the 12 items in the 
superiors’ rating form. These correlations tend to be high because of 
the familiar halo effect in ratings, and are not comparable with those in 
other columns. Nevertheless, it is of interest to consider the relative 
magnitude of the correlations in the first column as showing the impor- 
tance attached to the characteristics by the superiors in making their 
over-all evaluations. 

Six of the correlations are high and almost equally so—lInterest in 
Work, Sticking to a Job, Getting Along with Superiors, Knowledge of 
Administration, Knowledge of Teaching, and Understanding Written 
Communication. Inspection of the next column, showing correlations 
of the in-basket scorers’ ratings with the superiors’ ratings on these 12 
items, shows quite a different pattern. The highest correlations are 
those involving knowledge of teaching and communication skills. In- 
basket scorers seem to prefer principals who are judged by superiors as 
communicating effectively and as knowing teaching. The latter pattern 
is somewhat similar for staff members. 

The pattern of correlations of the Teacher Reaction Form score 
with the 12 superiors’ rating items affords an interesting contrast to the 
correlations in the first column, because teachers seem to value char- 
acteristics that have relatively low importance in the superiors’ over- 
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all impression. Teachers prefer principals who are rated by superiors as 
getting along well with teachers and parents and having good rapport 
with children; all these characteristics have relatively low correlations 
with the superiors’ over-all evaluation. The Consideration score of the 
Principal Behavior Description Questionnaire has a sizable correlation 
with only one superiors’ rating item, Getting Along with Teachers 
(.36). This tends to provide some validity for the questionnaire as a 
measure of behaviors that produce good relationships between principal 
and teachers. The highest correlation in the last column is only .20; but 
if Initiating Structure is to correlate with any of the 12 rating items, 
that item probably should be Knowledge of Administration. 

Except for the correlations with the scorers’ evaluations, most of the 
remaining correlations with the adjective check list are nonsignificant. 
Principals who were liked by staff members tended to be considered 
Urbane and Resourceful by scorers. One might have entertained the 
hypothesis that principals who are described as considerate by teachers 
would be judged by the in-basket scorers as Genial, Tactful, or Cour- 
teous, but such is not the case. The signs of the correlations are not 
even in the expected direction in most instances. 

To complete the presentation of the intercorrelations of the subjec- 
tive evaluations, Table 79 shows the correlations of the Scorers’ Check 
List with each of the items in the Superiors’ Rating Form. Many of the 
adjectives correlate with ratings of knowledge of teaching and of the 
various communication skills; the results suggest that what the scorers 
were reporting by checking the adjectives Urbane, Forceful, Painstak- 
ing, Resourceful, Logical, and even Tactful was that the principal ex- 
hibited a high level of cognitive ability. No significant correlations were 
found between those superior rating items reflecting social relationships 
and choice of adjectives such as Genial, Tactful, Courteous, or Witty by 
the in-basket scorer. It is rather evident that the scorers’ impressions of 
the “social” qualities of the principals whose in-basket responses they 
had scored do not correspond with either the superiors’ or the teachers’ 
impressions of what would be comparable qualities. This lack of re- 
lationship cannot be explained entirely by the relatively lower reliability 
of the Scorers’ Check List ratings for the adjective-pairs involved. It 
would appear that expressions of courtesy in in-basket work may be 
somewhat misleading. As has been suggested by the analysis of basic 
factors in in-basket work reported in Chapter 7, courtesy shown to sub- 
ordinates, to outsiders, and perhaps to superiors is a part of directing 
the work of others. These expressions of courtesy were probably the 
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chief basis of the in-basket scorers’ impressions, but they are perhaps 
best understood as formalities rather than as indicators of consideration 
in social relationships. 


CORRELATIONS OF OVER-ALL EVALUATIONS WITH 
MEASURED CHARACTERISTICS 


It has been shown that the four classes of judges—superiors, scorers, 
staff members, and teachers—may have quite different views as to what 
constitutes good work by an elementary school principal. The task 
now is to investigate in detail these different perceptions of good per- 
formance. The characteristics of principals who are perceived as good 
by superiors, by scorers, by staff members, and by teachers will be pre- 
sented and discussed. 


WITH BIOGRAPHICAL DATA 


Such items of information as (1) number of years of training, (2) 
amount of experience in teaching, and (3) experience in administrative 
work figure prominently in the data that are commonly used by super- 
intendents or school boards in choosing elementary school principals. 
Table 80 shows the correlations of over-all evaluations with such items 
of biographical information. 

The salient finding from Table 80 is that the correlations are pre- 
dominantly very low. Age and experience apparently have very little 
relationship to successful performance of the duties of an elementary 
school principal as viewed by any of the judges. Years of training simi- 
larly tend to be uncorrelated with these evaluations. 

While the correlations are for the most part not significantly differ- 
ent from zero, the predominance of negative correlations with age and 
experience is apparent. There seems to be a very slight tendency for 
all classes of judges to prefer the younger, less experienced principals. A 
small exception can be found for the Principal Behavior Description 
Questionnaire. The less experienced principals tend to be viewed by 
teachers as more considerate, while the older, more experienced princi- 
pals appear to be slightly more likely to initiate structure in the inter- 
actions of principal and teachers. 

There is a slight tendency for superiors to prefer the women prin- 
cipals (r= .19). The women are judged to initiate structure to a 
greater extent than the men principals (r= .27), who tend to be 
younger and less experienced. 
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WITH COGNITIVE MEASURES 

Measures of various kinds of cognitive abilities include the tests of 
professional knowledge and “general culture,” the basic mental ability 
tests, and the achievement test covering knowledge of the background 
materials studied during the test week. The correlations of evaluations 
with these measures are shown in Table 81. 

The correlations in the first column show that the superiors’ evalua- 
tions of principals’ behavior have very little to do with cognitive abilities. 
Although the correlations are mostly positive, they are low. The highest 
correlation is that with the School Administration and Supervision test 
mae) 2)): 

In sharp contrast are the in-basket scorers’ evaluations, where a 
correlation of .60 is found with School Administration and Supervision. 
Scores on tests of professional and general knowledge, reasoning ability, 
verbal knowledge, and fluency are definitely related to the scorers’ eval- 
uation. The scorers’ ratings were made immediately after a searching 
examination of written responses to the in-basket items and without 
any personal knowledge of the principals. Superiors, on the other hand, 
were perhaps more concerned with behavior observable only in face-to- 
face situations than they were with the ability of their principals to 
handle assignments involving analysis and writing (which are perhaps 
more revealing of cognitive aspects of performance). Staff members, 
whose five-day acquaintance with principals was restricted to face-to- 
face observation, and who can be assumed to be much less acquainted 
with the principals than were the superiors, made evaluations that cor- 
relate higher with cognitive measures than the evaluations of the su- 
periors. In interpreting these differences in correlation, one must keep 
in mind certain differences in rating conditions. The total number of 
staff members who acted as raters was about 15. One staff member 
was present at almost all sessions and rated more than 200 of the 
principals. Two other staff members rated more than 100 principals 
each; other raters were present only occasionally. On the other hand, 
the total number of superiors who acted as raters was greater than 50. 
Each rated only the principals from his school system who attended a 
particular test session. Thus, the staff members’ ratings tended more 
often to be made by the same judges, and these judges had a better 
acquaintance with the total range of ability than was true of the superiors. 

Teachers’ evaluations have almost no relationship with cognitive 
abilities. None of the correlations with the Teacher Reaction Form or 
with the Consideration scores is significant. There are a few significant 
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negative correlations with the Initiating Structure score: Principals with 
low scores on the general knowledge tests (Social Studies and Science 
and Mathematics) and on the general reasoning and visualization tests 
tended to initiate structure as reported by their teachers. 


WITH INTEREST MEASURES 


The most salient finding in Table 82 is that interests, as measured by 
the Strong Vocational Interest Blank for Men, have very little to do 
with how principals are evaluated. There is a very slight tendency for 
both scorers and staff members to prefer principals who resemble 
psychologists in the way they answer items in the Strong Vocational 
Interest Blank for Men. The Consideration score is correlated negatively 
with the physician score but positively with the sales manager score. 
Initiating Structure seems to go with interests like those of a president 
of a manufacturing concern. All these relationships are small. 


WITH BASIC PERSONALITY FACTORS 


Correlations between subjective evaluations and scores on the Six- 
teen Personality Factor Questionnaire are shown in Table 83. There are 
no correlations as high as .20 in the first four columns. This analysis 
of these scores adds little to understanding the kind of principals pre- 
ferred by various kinds of judges. 

There are a few correlations of interest in the last two columns. 
Principals who, according to their teachers, are Considerate tend to be 
Friendly, Enthusiastic, Adventurous (rather than shy), and Self-con- 
fident (rather than insecure). Principals who are high on Initiating 
Structure tend to be characterized by Character Strength rather than 
by a lack of conventional standards. All these correlations, although 
low, are in the expected direction. 


WITH IN-BASKET CATEGORY SCORES 


Table 84 presents the correlations of subjective evaluations with 32 
selected in-basket category scores. The in-basket scores used in com- 
puting these correlations were obtained from the three school in-baskets; 
the Bureau of Business responses were not used in this analysis. 

The correlations with the superiors’ rating are quite low. Only four 
correlations—those involving Discusses with Subordinates, Communi- 
cates Face to Face, Decides on Procedure, and Asks Subordinates—are 
significant at the .01 level (.17). Since these four scores all have rela- 
tively high loadings on both of the second-order factors, Preparation for 
Decision and Amount of Work, it is suggested that superiors have a 
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slight preference for principals who are high on these factors and that 
superiors’ ratings appear to be unrelated, or related in complicated ways, 
to other categories of in-basket behavior. This problem will be con- 
sidered again in Chapter 13. 

The correlations with scorers’ ratings tend to be much higher than 
those in any other column. Although the scorers could not have known 
the total in-basket score on any category at the time they made their 
ratings of the principals, they did carefully inspect all the responses for 
which they had the responsibility of scoring. In this sense, there is 
some contamination that might increase the correlations. Nevertheless, 
it is possible to interpret the correlations in terms of kinds of adminis- 
trative behavior of which the scorers approved. 

The highest correlation is with Number of Words (r = .61); scorers 
tended strongly to like principals whose verbal output was high. Cor- 
relations are also high with many of the categories that have high load- 
ings on Factors A, Exchanging Information; B, Discussing before Act- 
ing; and H, Directing Others. Significant negative correlations are found 
for the categories Careless and Prejudges. The correlations with the 
categories having high loadings on Factor C, Complying with Sugges- 
tions, vary from —.13 for Terminal Action to .38 for Follows Subor- 
dinates. If the second-order factors are considered, it seems that scorers 
prefer principals who are high on Factor Y, Amount of Work, and 
near the “preparation” end of the bipolar Factor X, Preparation for 
Decision vs. Taking Final Action. 

Only a few correlations in the staff members’ rating column are .20 
or higher; these involve the categories Asks Subordinates, Outsiders In- 
volved, Number of Words, Discusses with Superiors or Outsiders, and 
Recognition for Good Work. 

None of the correlations in the last three columns—those involving 
the Teacher Reaction Form and the two Principal Behavior Description 
Questionnaire scores—reached .20. The teachers’ evaluations of the 
principals, as reflected in the Teacher Reaction Form score, are almost 
completely unrelated to the in-basket category scores. 

Some of the correlations with the Consideration and Initiating Struc- 
ture scores are of interest because they are so low. For example, one 
might expect significant positive correlations of the Consideration score 
with certain in-basket measures such as Courtesy to Subordinates. In- 
stead we find a negative correlation (r = —.11). Why? The answer 
may be found in the factor analysis of category scores. The analysis did 
not reveal a consideration or a courtesy factor; instead, Courtesy to Sub- 
ordinates was found to have a sizable loading on Factor H, Directing 
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the Work of Others. Apparently Courtesy to Subordinates, at least as 
revealed in the in-basket scoring, is a device used to soften the blow of 
assigning work, and is not a measure of consideration. 

One might also expect that the Initiating Structure score would be 
associated with category scores that seem to imply strong leadership, 
such as Concluding Decision or Terminal Action. The correlations 
again turn out to be negative (—.16 and —.08 respectively). Again 
the factor analysis reveals a possible explanation. Concluding Decision 
and Terminal Action have high loadings on Factor C, Complying with 
Suggestions. High scores on these two categories do not necessarily im- 
ply strong leadership. 


WITH GROUP INTERACTION CATEGORIES 


The correlations of subjective evaluations with scores obtained from 
the group interaction problem are shown in Table 85. The scores in the 
upper half of the table were obtained from tabulations made by the 
experimenter and observer during the session, while the scores in the 
lower half were ratings made by the participants at the conclusion of 
the session. 

The categories at the top of the table are in general unrelated to 
evaluations of the principals. The correlations of .26 and .23 for staff 
members’ ratings should be discounted because of the fact that the 
tabulations and staff ratings were sometimes made by the same persons. 
A high rating might result in part from a staff member’s recollections 
about the behavior of a principal he had observed during the group in- 
teraction problem. 

The high correlations for staff members’ ratings in the lower part of 
the table are not subject to the same limits on interpretation. The raters 
and some ot the principals observed the same behavior in the interaction 
problem. The participants made their ratings on the basis of perform- 
ance in the interaction problem immediately following completion of 
the task, while the staff members’ rating was made at the end of the 
test week and presumably on the basis of more general observations. 
The correlations suggest that observation of group interaction may have 
provided an important basis for the staff evaluations. The staff members’ 
ratings agreed best with evaluations of Effectiveness in Presenting Facts. 

Teachers’ evaluations, generally speaking, are unrelated to these in- 
teraction scores. But superiors tended to prefer principals who were 
judged to be effective in presenting facts, and the in-basket scorers evalu- 
ated most highly those who were judged to be effective in presenting facts, 
to have talked a lot, and to have made many attempts to influence others. 
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WITH EDUCATIONAL CONCERNS 

Table 86 shows correlations between the evaluations and scores on 
categories of instructional awareness (derived from the concerns ex- 
pressed in responses to the teacher evaluation problems) and scores on 
categories of job performance values (from the educational problems 
presented by means of tape-recorded conferences). 

The number of concerns expressed by principals has little to do 
with superiors’ evaluations, although all the correlations are positive. 
The highest correlations are .21 and .22 with job performance values 
about Pupil Personnel and Planning and Structure. Correlations are 
noticeably higher for the scorers’ ratings, with most of the correlations 
exceeding .20 and two reaching .34. These higher correlations can per- 
haps be accounted for in terms of general quantity and quality of verbal 
output; both the rating and the scores are based on different samples 
of the writings of the principals. 

Correlations with staff ratings are very low, although all are positive. 
Correlations with Teachers’ Reaction, Consideration, and Initiating 
Structure are also uniformly low. It is interesting to note that principals 
who show instructional awareness for the category Evaluation are not 
thought to be considerate by their teachers (r = —.19). 

The good principal as seen by his superior. Superiors prefer those 
principals whom they view as well motivated for work in administration, 
who work well with others, who know their field, and who possess good 
academic skills. In addition, there are rather slight tendencies for su- 
periors to prefer principals whose performance on a test of professional 
knowledge is good, who prepare for decision by planning many dis- 
cussions, who are judged to be effective in presenting information to a 
group, and who express concern about pupil personnel and about plan- 
ning and structure. The salient characteristic of the good principal, as 
viewed by his superior, seems to be the ability to communicate effec- 
tively and to work well with others. 

The good principal as seen by the in-basket scorer. The scorers 
chose the adjectives Urbane, Forceful, Painstaking, and Resourceful in 
describing the good principal. They clearly prefer principals who do 
well on tests of professional and general knowledge, reasoning, verbal 
ability, and fluency, and who tend to exchange information, prepare for 
decisions by planning discussion meetings, organize their work, and 
write a lot in handling the in-basket items. There are also slight tend- 
encies for the scorers to prefer principals who participate effectively in 
group problem solving, who express any of a wide variety of concerns 
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in their solutions to educational problems, who in the opinion of superi- 
ors know their field and have good communication skills, and whose 
interests are like those of psychologists. Here the most salient finding 
is that the scorers prefer fp’ icipals whose written records of administra- 
tive behavior make them afppear to be bright, well-educated people. 

The good principal as seen by research staff members. The prin- 
cipals nominated by the research staff members as the best principals 
turn out to be those who get high scores on tests of professional and 
general knowledge and on measures of reasoning, verbal ability, and 
fluency. They are described by the scorers as Urbane and Resourceful 
and by superiors as knowing their field and having good communication 
skills. The research staff nominations also favor principals who are 
judged to participate effectively in group problem solving, and who in 
their administrative work tend to write a lot, exchange information, and 
organize their work. The research staff members tend to agree in their 
evaluations with the in-basket scorers, and their picture of the best 
principal is similar: They seem to prefer principals who are bright and 
well educated. 

The good principal as seen by teachers. The Teacher Reaction 
Form is a set of items to which teachers responded, and the score on 
this instrument is used here as a measure of the teachers’ over-all eval- 
uation. The nature of the measure is obviously influenced by the items 
it contains, and many of the items reflect Consideration. But there is 
perhaps a sufficient variety of items in the form to justify using its score 
as an over-all measure of teacher preferences. 

Findings from the study that tell what kind of person the teachers 
like as principals are meager. Teachers like principals who are judged 
by their superiors as getting along well with teachers, parents, and chil- 
dren. There are small indications that teachers like principals who are 
effective in presenting facts to a group and who are not shy. There is a 
marked tendency for teachers to prefer principals who are judged to be 
Considerate on the Principal Behavior Description Questionnaire; but 
this relationship may be enhanced by similarities of items on the two 
scales. About all that can be justified is the conclusion that teachers 
like principals who get along amicably with others in the school situa- 
tion. 

Characteristics of considerate principals. Principals who received 
high scores on Consideration are judged by superiors to get along well 
with teachers and parents. They tend slightly to refrain from showing 
concern about evaluation and they tend to be young and inexperienced. 
Their interests are like those of sales managers (not physicians), and 


24 ADMINISTRATIVE PERFORMANCE AND PERSONALITY 


according to the personality inventory they are friendly and enthusiastic, 
not shy and insecure. 

Characteristics of principals who initiate structure. There is a 
tendency for principals who receive high scores on Initiating Structure 
to be judged by their superiors as knowing administration. They tend 
to resemble presidents of manufacturing concerns in interests and to 
receive high scores on Character Strength on the personality inventory. 

All the relationships discussed in this chapter are based on simple 
correlation coefficients. Undoubtedly, many of the correlations are in- 
fluenced by intervening variables that obscure the relationships as re- 
vealed by single correlation coefficients. In a later chapter, some of these 
same interrelationships will be re-examined in the light of more power- 
ful statistical techniques that permit control of the effects of a number 
of variables while investigating the influences of others. 


Chapter 12 


RELATIONSHIPS AMONG 
MEASURES OF PERFORMANCE 


THE MAJOR PURPOSE OF THIS AND THE FOLLOWING CHAPTER IS TO 
bring together all the measures that have been decribed in earlier chap- 
ters and to examine their relationships to the factors found in the in- 
basket tests reported in Chapter 7. This chapter will consider the 
correlations between composite scores based on the in-basket perform- 
ance factors and all the other variables pertaining to the principal’s 
ability, personality, and performance. These other variables include: 


1. Thirteen superiors’ rating items describing the principal’s per- 
formance in his regular position. (See Chapter 9.) 

2. Three scores based on teachers’ questionnaire descriptions of 
their principal’s performance in his regular position. (See Chapter 9.) 

3. Two over-all ratings of the principal, one made by members of 
the research staff and the other made by in-basket test scorers. (See 
Chapter 9). 

4. Twelve categories of instructional awareness that were obtained 
from the responses of the principals to the three kinescopes that showed 
probationary teachers in their classrooms. (See Chapter 9.) 

5. Six categories of job performance values based on the special 
educational problems that were presented by means of tape recordings. 
(See Chapter 9.) 

6. Four biographical variables: age, total years in administration, 
total years of professional work, and total years of academic prepara- 
tion. (See Chapter 5.) 
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7. Ten group interaction categories from the group interaction 
problem. (See Chapter 10.) 

8. Ten speech categories from the tape recording of the speech. 
(See Chapter 10.) 

9. Sixteen basic mental ability test scores. (See Chapter 5.) 

10. Four scores from the tests of professional and general knowl- 
edge. (See Chapter 5.) 

11. Five background achievement scores from a test of what the 
principal had learned during his study of the background materials pro- 
vided. (See Chapter 5.) 

12. Fifteen basic personality factors. (See Chapter 5.) 

13. Ten scores from the Scorers’ Check List. (See Chapter 11.) 

14. Twelve background orientation categories. (See Chapter 9.) 

15. Eighteen scores from the Strong Vocational Interest Blank for 
Men. (See Chapter 5.) 

16. The 25 in-basket category scores that were not included among 
the 40 upon which the factor analysis reported earlier was based. (See 
Chapters 6 and 7.) 


The first section of this chapter will describe the development of a 
set of eight composite scores, one for each of the first-order in-basket 
test factors. The second section will present and discuss the correlations 
between the eight composite scores and each of the 165 variables men- 
tioned above. The final section will consider the possibility of utilizing 
the second-order factors as a framework for a more general understand- 
ing of these relationships. 


COMPOSITE SCORES 


As the first step in the analysis of the relationships between in- 
basket performance and the other 165 variables of the study, certain in- 
basket category scores were combined to form approximations of factor 
scores to represent each factor. Henceforth, these scores will be re- 
ferred to as composite scores. To obtain a composite score, those 
category scores that had the highest loadings on the factor involved 
and that had low loadings on all other factors were combined. Simple 
weights were applied to the category scores before they were added in 
order to compensate for any major differences in variability of the 
category scores. The in-basket composite scores are approximate meas- 
ures of the factor; nevertheless they will be useful in examining relation- 
ships between in-basket test performance and other variables of the 
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TABLE 87. Composition of eight in-basket composite scores* 


Oblique 
Composite Scoring Category Factors S.D. Weight 
Loading 
A. Exchanging Information Asks Subordinates 50 7.99 1 
Informs Subordinates 45 6.52 1 
B. Discussing Before Acting Discusses with Subordinates .62 10.14 1 
Communicates Face to Face .60 12.65 1 
Decides on Procedure .46 11.50 1 
C. Complying with Suggestions Concluding Decision aS US? 1 
Follows Subordinates .65 5.07 i 
Terminal Action 59 10.31 1 
D. Analyzing the Situation Program Values 82 4.64 1 
Conceptual Analysis oO 7.04 1 
E. Maintaining Relationships Superiors Involved 54 4.74 ee 
Discusses with Superiors 42 4.78 2 
Outsiders Involved 41 728) 1 
Relates to Other Materials 37. 7.00 1 
F. Organizing Work Immediate Work Scheduled 50 7.18 1 
Intermediate Work Scheduled .51 7.46 1 
G. Responding to Outsiders Informs Outsiders 44 4.18 1 
Follows Outsiders 41 3.96 1 
Courtesy to Outsiders .44 3.87 1 
H. Directing Others Leading Action .64 14.94 1 
Courtesy to Subordinates pul 13.64 1 
Directs 47 13.74 1 


* Data are for all four in-basket tests combined. 


study. Table 87 gives the category scores selected to represent each 
factor, their loadings on the factor, their standard deviations, and the 
weights assigned to raw scores to obtain the composites. 

In-basket composite scores for factors A through H were computed 
for each principal on the three Whitman School In-basket Tests com- 
bined. The Bureau of Business In-basket Test was eliminated from the 
composite scores in order to focus attention on performance in the 
school situation. Table 88 presents the means, standard deviations, es- 
timated reliabilities, and intercorrelations for the scores. 


CORRELATIONS WITH OTHER VARIABLES 


Each of these 165 variables was correlated with each of the eight 
factor scores and with the category score Number of Words. The re- 
sulting 9 x 165 matrix is presented in Table 89. The discussions that 
follow will be based primarily on the correlations in this table. 
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CAUTIONS 

The standard error of a correlation of .00 computed on a sample of 
232 cases is .066. If a set of correlations such as those in Table 89 
were computed on a completely chance basis, such as for a set of ran- 
dom numbers, then it would be expected that 10 per cent (or 149 cor- 
relations) would have a value of at least +.11; one per cent (or 15 
correlations) would reach a value as high as or higher than +.17; and 
at least one correlation in the entire table would be as large as or larger 
than +.20. It is necessary, therefore, to exercise caution in the interpre- 
tation of the 1,485 correlations presented in Table 89. With minor ex- 
ceptions, only those correlations exceeding -+-.20 will be considered in 
the interpretation. 

A general inspection of the correlations reported in Table 89 shows 
that a large proportion of the coefficients are larger than can be ex- 
plained by the null hypothesis of no real relationship between the com- 
posite scores and the other variables. (Approximately 465 reach or 
exceed +.17, the .01 level of significance as compared with 15, the 
number expected by chance.) Significant correlations occur in each 
of the areas used in the organization of Table 89. 

A second important consideration in interpreting the relationships 
stems from the inherent complexity of each of the composite scores. 
Neglecting errors of measurement, each category score from which a 
composite score was formed and, hence, each composite score, is made 
up of as many as four components: (1) amount of work, identified as 
second-order factor Y, (2) preparing for decision vs. taking action im- 
mediately, identified as second-order factor X, (3) a component that is 
independent of the two second-order factors and that is unique to the 
primary factor, and (4) a component that is due to the uniqueness of 
each of the category scores that are combined to form the composite 
score. These components are functionally inseparable. Second-order 
factors can be considered independently only by special analysis and 
may be thought of as generating the performance expressed or made 
observable by the two unique components. The correlation between a 
composite score and another variable is influenced by all four of these 
components in proportion to the relative weights of the components in 
the score. (The problem of the complexity of in-basket test scores is 
considered again in the final section of this chapter and is the object of 
a major analysis reported in Chapter 13.) 

A third caution concerns the differences in the reliability of the 
measurement of each of the variables. If two variables are measured 
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with different reliabilities, the probability of their showing a correlation 
of a given value with a third variable will be different. A variable meas- 
ured less reliably than another is likely to show a lower correlation with 
the third variable, even though the “‘true” relationship of the two with a 
third is the same. In interpreting the correlations in Table 89, interest 
is in the “true” relationship rather than in the “observed” one. Estimates 
of the reliability of each of the 165 variables are listed in the tenth col- 
umn of Table 89. 


ESTIMATED NUMBER OF WORDS 


The scoring category Number of Words is included in Table 89 be- 
cause of its significance for an understanding of the results of the 
study. In the case of many of the major variables in Table 89, written 
responses provided the information from which the scores were derived. 
All the measures of performance from the in-basket situations, from the 
films, and from the tape-recorded educational problems were derived 
from written responses. Should a principal be handicapped by lack of 
ability or inclination to write, he would be at a serious disadvantage in 
attempting to show his skill as an administrator in these test situations. 

Many of he problems that were introduced into the in-basket tests 
could in real life be expected to occur during face-to-face interactions 
and might have been handled on the spot without writing. Since for 
this study the work of each principal had to be available for inspection 
and scoring, however, it was necessary to require that all responses to 
in-basket tests be written. This requirement might be responsible for the 
appearance of an artificial emphasis on writing skill in the results. 

To what extent are the findings limited by the emphasis on writing 
as a method of collecting data? To take an extreme point of view, the 
study might be regarded as a grand test of the principal’s ability to pro- 
duce quantities of written material under stressful conditions and within 
the time limits permitted. Many of the principals, on occasion, com- 
plained good-naturedly of “writer’s cramp.” Certainly, from their point 
of view, large quantities of writing had to be produced. 

The data of the study, however, do not support such an extreme in- 
terpretation. The eight composite scores show marked variations in 
their correlations with the category score Number of Words. These 
correlations are shown in Table 90. 

Correlations of the 12 categories used in scoring responses to the 
films with Number of Words range from .26 to .39. The six categories 
based on responses to the tape-recorded problems range from .13 to .40. 
There can be little doubt that the quantity of writing produced can be 
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TABLE 90. Correlation of composite scores with number of words 


Correlation with 


Composite Number of Words 
A. Exchanging Information .63 
B. Discussing before Acting BY) 
C. Complying with Suggestions yet 
D. Analyzing the Situation Yee | 
E. Maintaining Relationships .66 
F. Organizing Work .40 
G. Responding to Outsiders i) 
H. Directing Others .64 


used to “explain” a part of the observed relationships among variables, 
but it is equally clear that the quantity of writing cannot explain all 
relationships. 

The question may be viewed in another way. The ability to accom- 
plish large quantities of written work under stress of time pressures may 
be regarded as necessary for successful administration. Certainly, abil- 
ity to write and to use language skills effectively can be defended as a 
reasonable requirement for those who provide educational leadership. 
Each of the principals involved in this study had demonstrated a high 
degree of literacy by the fact of having completed from two to seven 
years of college work. Every principal should have had the minimum 
essential ability to write. No particular attention was given in this study 
to writing skill such as would be reflected in proper grammar, word us- 
age, or composition. Emphasis in scoring was entirely on differences in 
responses that pertained to variables of administrative performance. 

The most satisfactory way of regarding the problem of writing in this 
study was to recognize the presence of such an emphasis on writing, 
but at the same time to look for the other important differences in the 
performance of principals that showed through the sheer amount of 
writing done. The methods employed in this research are basically 
similar to methods used in other fields of scientific investigation. In 
the study of miscroscopic structures of organisms, for example, stains 
are used to prepare tissues for observation. Staining clearly may intro- 
duce artifacts of color, etc., in what is observed, but the technique is 
nevertheless invaluable in making structures observable that could not 
otherwise be studied. Artifacts introduced by a method of investigation, 
if recognized and properly regarded, do not invalidate the use of that 
method or technique of investigation. 


| 
: 
: 
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CORRELATIONS OF COMPOSITE SCORES WITH 
OTHER MEASURES 


COMPOSITE SCORE A: EXCHANGING INFORMATION 

The role of the administrator in organizational communication 
emerges clearly in the factor analysis of the in-basket test responses. 
The specific behaviors most clearly involved in the exchange of infor- 
mation are asking others for information (or opinion) and giving others 
information (or opinion). The principal thus appears as an important 
“center” in a communication net. His communication activities link 
him with his superiors, with his teachers and pupils, and with the gen- 
eral community. From the point of view of an organizational com- 
munication net, the principal might be regarded as a channel through 
which superiors, subordinates, and outsiders communicate with each 
other about school issues. 

As might be expected, many of the other measures are related to 
the degree to which the principal exchanges information. This section 
will point up differences between the “high communication” and “low 
communication” principals in abilities, performance, and other personal 
characteristics. 

One important aspect of exchanging information appears to be the 
communication of affect or sentiment. This is suggested by the fact that 
Composite Score A, Exchanging Information, is positively related to 
Recognition for Good Work (r = .39) and to Human Values (r = .30). 
Thus, it seems that the content of the communication involved in this 
composite score includes not only fact and opinion but also attitudes of 
recognition and approval or disapproval. 

Exchanging information is also related to the principal’s perform- 
ance in test situations other than the in-basket. Exchanging informa- 
tion is clearly related to the concerns expressed by the principal in 
completing his reports and interview outlines for the probationary teach- 
ers. Concerns about personality (r= .35), methods of instruction 
io 50), objectives (1— .28), evaluation’ (r= 28), curriculum 
(r = .28), child growth and development (r = .25), materials used 
in instruction (r = .24), planning (tr = .22), and pupil participation 
(r = .21) were expressed more frequently by the principals who score 
high on Composite A, Exchanging Information. Likewise, in responding 
to the five educational problems presented by tape recordings, the “high 
communication” principals showed more concern with instruction and 
curriculum (r = .35), employees as persons (r = .29), planning (r = 
.26), and public relations (r = .24). In the group interaction situation, 
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the high communication principals were recognized by the members of 
their groups as more effective in presenting facts (r = .24) and making 
decisions (r=... 19): 

The principals’ performance in delivering the speech to the PTA 
showed a positive relation to their scores on Composite A. High com- 
munication is related to pronunciation (r = .43), word usage (r = .39), 
clarity (r = .39), voice control (r = .31), and voice interest (r = .26) 
in the delivery of the speech, and to making an effective introduction 
(r = .30) or conclusion (r = .30); to the organization of the body of 
the speech (r = .33); and to interest and efficiency (r = .29). 

High communication principals scored higher than the “low” on 
both of the two special professional examinations that were administered 
prior to the test week: the School Administration and Supervision ex- 
amination (r= .50) and Education in the Elementary School (t = 
.50). Both examinations measure knowledge of educational procedures 
and practices and may be viewed as indicative of the technical or pro- 
fessional competence of the principal. The relationships suggest that 
possession of professional knowledge may be necessary for effective ex- 
change of information. 

The principals who displayed higher amounts of communication 
also scored higher on the two sections of the NTE, Common Examina- 
tion: Social Studies, Literature, and Fine Arts (r =.50) and Science 
and Mathematics (r = .23). It appears that achieving a liberal educa- 
tion background is also consistent with effective exchange of information. 

Many of the short tests of basic mental abilities were found to be 
related to high Composite A scores. Verbal knowledge (r = .42) and 
word fluency (r= .41) especially characterized the principals who 
scored high on Composite A. Other abilities related to high scores on 
this composite include associational fluency (r = .38), inductive rea- 
soning (r = .35), ideational fluency (r = .35), number facility (r = 
.31 and .31), speed of closure (r = .28 and .17), flexibility of closure 
(r = .27), expressional fluency (r = .25), general reasoning (r = .24), 
deductive reasoning (r= .22), and visualization (r= .22). These 
relationships obviously involve a wide spectrum of basic abilities. 

In the area of basic personality factors, the high communication 
principals are relatively more emotionally sensitive (r = .26) and show 
less regard for conventions (r= .20). They can be described (by 
reference to their 16 PF scores) as sensitive, gentle, aesthetic, and not 
overly committed to convention or rules of conduct. 

In their performance during the study of background materials, the 
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high communication principals appeared to have an orientation toward 
both the educational needs of pupils (r = .23) and the concerns of 
the community (r= .23). Their interests, as measured by the Strong 
Vocational Interest Blank for Men, tended toward those of psychologist 
(cr = .31), lawyer (r = .25), and city school superintendent (r = .20). 
In contrast, their interests were negatively related to those of policeman 


(r = —.28), production manager (r = —.24), and purchasing agent 
(r = —.21). They tend toward the feminine side of the masculinity- 
femininity continuum (r = —.20). Neither age, experience, nor years 


of academic preparation show notable relationships to Composite A. 

The amount of exchanging information that characterizes a prin- 
cipal’s administrative performance is also clearly and positively related 
to the impressions he made on his superiors and on outsiders who had 
an opportunity to view the products of his work. Superiors indicated 
that the principals with high Composite A scores had greater knowledge 
of teaching (r = .31), oral communication skill (r = .28), ability to 
understand instructions (r = .24), interest in their work (r= .22), 
ability to stick to a job (r = .22), knowledge of administration (r = 
.21), and written communication skill (r= .20). The in-basket test 
scorers’ ratings favored high communication principals (r= .59). On 
the Check List the scorers described their impressions of the high com- 
munication principals by more frequently checking such personal quali- 
ties as resourceful (r= .53), urbane (r= .47), wordy (r= .42), 
forceful (r= .40), witty (r= .39), painstaking (r = .37), tactful 
wre—.o4), and logical (r = .32). 

The members of the research staff also were favorably impressed by 
principals who scored high on Composite A (rt = .28). Teachers’ re- 
ports on the behavior of their principals did not, however, show a 
significant relationship with Composite A scores. 

In summary, Exchanging Information in school administration re- 
lates to many areas of the principals’ work and seems to be associated 
with a broad spectrum of basic abilities and professional knowledge. 
The interests, orientations, and personal qualities of those principals 
who show high communication patterns in their work indicate that they 
are concerned with pupil needs and with the community, and are in- 
terested in people and facts about people. 


COMPOSITE SCORE B: DISCUSSING WITH OTHERS BEFORE ACTING 


The in-basket performance factor Discussing with Others before 
Acting is represented by Composite B. The principals differed widely 
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in the frequency with which they planned to involve others in discussion 
of problems before taking final action on them. Such discussion may 
be viewed in two ways. On the one hand, it may be seen as a method 
used by the uninformed or less competent principal simply to obtain 
help with a problem; on the other hand, it may be seen as a method 
used by a competent principal who recognizes the complexity of a prob- 
lem situation and the need for more information or for involving others 
before he acts. That the former may not always be the case will be 
illustrated by the data that follow, which show that those principals who 
scored high on Discussing before Acting tended to perform better and 
to be rated higher by superiors and by scorers than were those who 
scored low.! Discussion is not only a means of securing information to 
ensure better decisions on given problems, but may also be a step to- 
ward carrying a decision into action. 

Discussion with others overlaps considerably with the area men- 
tioned above, Exchanging Information; the correlation between Com- 
posite Scores A and B is .47. 

Composite B is related to some of the category scores from the in- 
basket that were not among the 40 used in the factor analysis. First to 
be noted is that Composite B is related to giving recognition for good 
work (r = .37) and to the use of human values (r = .35). The rela- 
tionships suggest that discussions may be used, in part at least, to 
communicate sentiments and attitudes. The small negative correlation 
with scores on being socially insensitive (r = —.19) adds to the inter- 
pretation of this composite score as including more than the use of dis- 
cussion to secure assistance in making decisions. 

As contrasted with Exchanging Information (Composite A), Dis- 
cussing before Acting obviously involves plans for the face-to-face mode 
of communication to a far greater extent than either telephoning or 
writing. 

Scores on Composite B are related to other activities of the test 
week, including measures obtained from the principals’ reports and 
interview outlines on the probationary teachers. Concerns about the 
teacher’s personality (r= .32), methods of instruction (r= .31), 
pupil interest (r = .30), objectives (r = .29), planning and continuity 
(r = .28), pupil participation (r = .26), curriculum (r = .25), class- 

*In order to avoid apparent inconsistency with the results of the analysis 
reported in the following chapter, the results of that analysis must be anticipated. 
That part of Discussing with Others that is associated with the second-order com- 
ponent, Preparation for Decision, accounts for the positive relationship noted 


here. Discussion not related to preparing for decision is negatively regarded by 
superiors. 
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room climate (r= .21), and materials of instruction (r= .20) are 
expressed more frequently by principals who more often plan to dis- 
cuss problems with others. These positive relationships continue to be 
observed in the principals’ reactions to the tape-recorded problems. 
The correlations between Composite B and the job performance values 
planning (r= .35), employee personnel (r = .29), instruction and 
curriculum (r = .20), and pupil personnel (r = .20) show this rela- 
tionship. 

The length of speech delivered by the principal in addressing the 
local PTA is related to Composite B scores (r = .21), as is each of the 
other categories that were employed to score the speech: introduction 
(r = .28), organization (r = .28), conclusion (r = .26), word usage 
Meee) clarity (r= .23), voice control (tf = .27), voice interest 
fie —..24)> pronunciation (r = .33), and efficiency (r =':30). 

The scores earned on the professional and general knowledge ex- 
aminations showed positive correlations with Composite B scores: Ad- 
ministration and Supervision (r = .47), Elementary Education (1 = 
.45), Social Studies (r = .37), and Science and Mathematics (r = 
.26). Principals scoring high on Composite B mastered the back- 
ground materials to a greater degree than did those who made lower 
scores. Composite B scores are related to achievement of knowledge 
about the community (r = .41), educational program (rt = .37), staff 
(r = .34), organization (r = .28), and funds and facilities (r = .25). 
Many of the basic mental ability test scores were also related to Com- 
posite B, including associational fluency (r = .33), ideational fluency 
(r = .32), inductive reasoning (r= .31), number facility (r = .24 
and .30), verbal knowledge (r = .29), flexibility of closure (r = .29), 
visualization (r= .26), word fluency (r= .26), general reasoning 
(r = .24), speed of closure (r = .26 and .23), and expressional flu- 
ency (r= .21). Again the spectrum of abilities related to high per- 
formance in the area is wide, but verbal knowledge and word fluency 
do not dominate the list as strongly as in the case of Composite A, 
Exchanging Information. Fluency in forming associations or obtaining 
ideas received relatively more emphasis. 

The basic personality factors are unrelated to scores on Composite B. 

With respect to the background materials, principals who are high 
on Composite B tend to show a concern with the educational needs of 
pupils (r= .20) and, to a somewhat lesser extent, with school or- 
ganization and politics (r= .18). Their interests tend to correspond 
with those of lawyers (r = .22) and perhaps psychologists (r = .18) 
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and to contrast with those of policemen (r = —.21) and accountants 
(r = —.20). 

As was the case with Exchanging Information (Composite A), dis- 
cussing problems with others before acting shows no consistent pattern 
of relationships with age, experience, or academic preparation. 

Those principals who demonstrated superior professional know]- 
edge, superior performance on tests of professional knowledge, on the 
other achievement and ability tests, and in the ratings by others were 
also those who more frequently planned discussions. Therefore there is 
reason to be cautious in simply interpreting discussing with others as a 
technique by which the less competent principals buttress their ability 
to make decisions. A more consistent interpretation is that planning to 
discuss problems with others implies a more complete recognition of 
the complex nature of the in-basket problems. 

The superiors’ ratings reveal their view of the skills of principals 
who plan to discuss problems with others. Ratings of informal oral 
communication correlate substantially with Composite B scores (tr = 
.38). Superiors also describe the principals scoring high on Composite 
B as high on understanding written instructions (r = .32), knowledge 
of teaching (r = .28), interest in work (r = .25), formal oral com- 
munication skill (r = .24), ability to stick to the job (r= .19), and 
knowledge of administration (r = .20). 

All those who provided an over-all rating of the principals favored 
principals who planned to discuss problems with others: superiors (r = 
.24), scorers (r= .54), and staff members (r= .19). Teachers did 
not show a definite positive preference (as indicated by their Considera- 
tion, Initiating Structure, or Teachers’ Reaction scores) for principals 
who plan more frequently for discussions. 

In completing the adjective Check List, the scorers associated the fol- 
lowing characteristics with principals who scored high on Composite B: 
urbane (r = .50), resourceful (r = .48), tactful (r = .38), painstaking 
(r= .36), forceful (tr = .35), logical (t = .35), wordym toes 
and witty (r = .22). 

In summary, the area of administrative performance identified as 
Discussing before Acting (Composite B) appears to be characteristic 
of the better-prepared principals. This aspect of administrative per- 
formance has implications beyond simply obtaining assistance in de- 
cision making. To some degree, discussion of a problem with others 
may represent a first step toward final action, and thus may be viewed 
in part as a transition between analysis of the problem and carrying 
decisions into action. 
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COMPOSITE SCORE C: COMPLYING WITH SUGGESTIONS 

MADE BY OTHERS 

Many of the problems that were included in the in-basket tests were 
handled by following leads or suggestions made by someone else. About 
three-quarters of the items in the in-baskets contained “leads,” i.e., sug- 
gestions about what the principal might do. Complying with leads of 
others constituted the third factor in the in-basket performance of the 
principals. 

Composite Score C might be interpreted as a measure of passive 
compliance. This interpretation is not supported, however, because in 
addition to in-basket scoring categories that clearly imply compliant 
behavior (such as Follows Subordinates, Follows Superiors, and Follows 
Structure), the category scores Concluding Decisions and Terminal Ac- 
tion are positively loaded on Factor C (see Table 23). These latter 
scoring categories suggest active or even aggressive rather than passively 
compliant behavior. This factor is to be regarded as an active compli- 
ance with suggestions of others, not a passive one. 

The preferred mode of communication of the more actively com- 
pliant principals is writing (as shown in Chapter 7, the loading of Com- 
municates by Writing on Factor C is .45). There are also other indi- 
cations that compliance is associated with a general tendency to avoid 
direct interactions; the in-basket scoring category Asks Outsiders, for 
example, correlates negatively (r = —.20) with Composite Score C. 
Interests and personality as measured by the Strong Vocational Interest 
Blank for Men and the basic personality factors showed little or no as- 
sociation with Composite C. 

Principals who scored high on Composite C showed a tendency to 
have difficulties in making effective speeches to the local PTA. Scores 
on Composite C are negatively related to effectiveness of introduction 
(r = —.20) and to efficiency (r = —.21). 

With the exception of two negative associations, compliance as meas- 
ured by a high Composite C score did not relate to other areas of the 
principals’ performance. The two exceptions, however, indicate that 
the compliant principals tended to be concerned with neither objectives 
(r = —.29) nor evaluation (r = —.19) in responding to the tasks of 
judging the work of probationary teachers. Lack of concern implied by 
these correlations might be attributed to lack of background from which 
to judge and evaluate, but such an interpretation is not supported by the 
correlations with either the Administration and Supervision test (rt = 
05) or the Elementary Education (r = .01). Neither do the ability 
factors account for these negative relations with compliance. In fact, 
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the more compliant principals tend to score somewhat higher on general 
reasoning (r = .23) and to do slightly better on most of the other tests 
than the other principals. The compliant principals also show a slightly 
higher mastery of background materials, as indicated by positive correla- 
tions in all areas and particularly with the educational program (rt = 
.20) and staff (r = .23). 

Inspection of biographical information provides help in interpreting 
the observed negative relationships. Higher Composite C scores are 
earned by the younger principals (r = —.19) with less experience 
(r = —.19). Inexperience rather than lack of professional knowledge 
may be a factor in these principals’ apparent lack of concern for objec- 
tives and evaluations. 

Unlike the two preceding composite scores, for which high perform- 
ance was associated with general approval, the performance of highly 
compliant principals is neither strongly approved nor disapproved. Su- 
periors’ ratings show no preference for compliant principals (tr = 
—.05). Scorers of the in-baskets are not impressed by compliance 
(r = .13), but they indicate that the compliant principal is forceful 
(r = .23) and terse (r = .22). Correlations with staff impressions and 
teachers’ questionnaires are not significant. 

In general, active compliance as a means of meeting administration 
problems is rather neutral in its over-all contribution to the impression 
the principal made on those who judged his behavior and is, perhaps, a 
response stemming from inexperience rather than lack of ability. 


COMPOSITE SCORE D: ANALYZING THE SITUATION 


Every administrative problem occurs in context with others that are 
related; thus each problem has the possibility of possessing broader rami- 
fications than at first seem apparent. The principals differed markedly in 
the degree to which they gave evidence of having seen such implications 
of problems. A factor identified as Analyzing the Situation (Factor D) 
was found in the study of responses to in-basket items. Composite D 
scores are based on the sum of two in-basket categories, Conceptual 
Analysis and Program Values. This score will be the subject of this 
section. 

The principals who scored high on Analyzing the Situation also 
tended to make use of human values in responding to problems (r = 
.48), gave recognition to subordinates for good work (r = .32), ex- 
plained actions to subordinates (r = .26), and coordinated the activities 
of their associates and subordinates (r = .22). Analyzing the Situation 
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thus contains a definite element of recognition and evaluation of the 
work of others, mixed with a sensitivity to human reactions. 

Principals who displayed the greater amounts of situational analysis 
in handling the in-basket problems were more concerned with child 
growth and development (r= .28), planning (r = .27), objectives 
(r = .25), and curriculum (r = .20) in responding to the films of the 
probationary teachers. In their responses to the tape-recorded problems, 
these principals were more concerned with pupil personnel (r = .24). 
Their concerns seemed to be centered in the area of the education pro- 
gram and its effect on children. 

Principals scoring high on Composite D also scored higher on several 
of the categories that were used to evaluate the speech to the PTA. 
Their high speech scores were on organization (r = .24), voice control 
f—=21)) pronunciation (r — .26), and efficiency (r= .20). 

Professional and general knowledge test scores were positively re- 
lated to situational analysis: Administration and Supervision (t = .32), 
Elementary Education (r = .32), and Social Studies (r= .29). Re- 
lationships with the basic mental ability test scores include verbal knowl- 
edge (r = .32), ideational fluency (r = .25), and deductive reasoning 
(tr = .22). Analyzing the Situation was related to achievement on the 
background information examination in the areas of community (tr = 
.21) and school organization (r = .21). 

The scores described those principals earning high Composite D 
scores as relatively resourceful (r= .28), urbane (r= .26), witty 
(r = .24), and logical (r = .20). Scores on the basic factor personality 
factors did not add to this picture. 

In terms of their interests as measured by the Strong Vocational In- 
terest Blank for Men, those principals displaying higher amounts of 
situational analysis were similar to psychologists (r = .22) and public 
administrators (r = .19). Total years of experience in educational work 
appears to have only a negligible relationship with situational analysis. 

In their ratings of the principals, superiors indicated that those with 
high scores on Composite D, Analyzing the Situation, tended to have 
greater knowledge of teaching (r= .21) and of administration (r = 
.20), but the over-all impression of the principals had little to do with 
Composite D (r = .10). In-basket scorers tended to prefer principals 
who earned high scores on Composite D (r = .29). On the other hand, 
neither the staff members’ ratings nor the responses of teachers in their 
descriptions of the principals showed substantial relationships with these 
scores. 

In summary, those principals who earned higher scores on Analyzing 
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the Situation appear to be those with a somewhat greater fund of knowl- 
edge and experience. Their interests and concerns tend to be directed 
to the conceptual aspects of education, particularly to the welfare of the 
individual. 


COMPOSITE SCORE E: MAINTAINING ORGANIZATIONAL 

RELATIONSHIPS 

The school administrator works within a social organization and 
must maintain effective relationships with it. A most significant part of 
maintaining relationships with his organization is in his interactions with 
his superiors. Of almost equal importance, however, are his interactions 
with those outside the school, particularly with parents and members of 
the community. Relationships with these latter individuals often involve 
matters of school policy or precedent. To involve superiors and outsiders 
in handling administrative problems is to recognize that such people 
have a legitimate interest in these problems and that it is wise to maintain 
good relationships with them. 

From the results of the factor analysis and from correlations between 
Composite E and in-basket scores comes a suggestion that Factor E 
contains an element of deference and respect. Decisions about problems 
are not delayed, postponed, or temporized (loading = —.38). The 
telephone is emphasized as a mode of communication (loading = .26). 
Superiors’ opinions are sought (asks superiors, r= .45) and they are 
kept informed (informs superiors, r= .42). The principals refer to 
superiors (r = .30) and explain to superiors (r = .20). The same type 
of respectful or deferential behavior extends to outsiders, but to a lesser 
degree (asks outsiders, r = .26; explains to outsiders, r= .15). 

Respectful and deferential behavior to superiors and outsiders is 
not the only facet of maintaining organizational relationships. Principals 
scoring high on this composite also tend to give recognition for good 
work on the part of their subordinates (r = .27) and to back up their 
staff (r = .21). There is also present an element of concern for human 
values (human values, r = .22). 

In their responses to the films showing probationary teachers at 
work, the principals scoring high on Composite E displayed concerns 
about the teacher’s personality (r = .28), curriculum (r = .25), meth- 
ods of instruction (r = .23), child growth and development (r = .21), 
and materials of instruction (r = .20). In their reactions to the special 
educational problems presented on tape, these high-scoring principals 
showed concerns about employed personnel (r = .35), instruction and 
curriculum (r= .29), pupil personnel (r= .26), public relations 
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(r = .21), and planning (r = .21). Their performance in group inter- 
action was marked by a tendency to give positive information (r = .20). 
In making their PTA speeches, principals scoring high on Composite 
E made a more effective introduction (r = .21), showed better organ- 
ization of the body of the speech (r = .19), and used words well: word 
ence it -— 2()),) clarity (cr = .27), and pronunciation (r= .25). 

The scores on tests of professional and general knowledge show a 
definite positive relationship to Composite E scores: Administration and 
Supervision (r= .41), Elementary Education (rt = .42), and Social 
Studies (r = .23). A large number of the basic mental ability tests are 
also positively correlated with maintaining organizational relationships: 
associational fluency (r = .36), number facility (r = .28 and r = .34), 
verbal knowledge (r = .33), word fluency (r = .33), inductive reason- 
ing (r = .33), speed of closure (r = .29 and r = .20), general reason- 
ing (r= .27), ideational fluency (r = .27), visualization (r = .27), 
flexibility of closure (r= .25), and deductive reasoning (r = .23). 
The principals who scored high on Composite E, Maintaining Organiza- 
tional Relationships, also absorbed more of the background information 
in their study during the first day and one-half of the test week: staff 
(r= .32), community (r= .31), educational program (r= .30), 
funds and facilities (r = .23), and organization (r = .22). 

The correlations of the Scorers’ Check-List items with Composite E 
scores provide a description of their impressions of the high-scoring 
principals. These correlations were substantial for the adjectives re- 
sourceful (r = .46), urbane (r = .38), wordy (r= .38), witty (r= 
ma eorcetul (tr ='.32), logical (r= .31), tactful (r= .25), and 
painstaking (r = —.24). 

No additional information toward a personality description is pro- 
vided by the basic personality factors or by the Strong Vocational In- 
terest Blank for Men. All the correlations are small and generally 
insignificant. 

Principals scoring high on Composite E are described by their su- 
periors as having relatively high oral communication skill (r = .20). 
They made favorable impressions on the in-basket test scorers (r = .47) 
and on the members of the research staff (r = .22). Teacher reactions 
appeared to be unrelated. 

In summary, Maintaining Organizational Relationships (Factor E) 
is most characteristic of principals possessing superior professional 
knowledge and a wide range of basic abilities. High-scoring principals 
show concern with organization and with the behavior of people sub- 
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ordinate to them. Personality and interest scores do not seem to be re- 
lated to scores on Composite E. 


COMPOSITE SCORE F: ORGANIZING WORK 

Within the limited time the principals had to work, all the problems 
presented by the items in an in-basket could not be handled completely. 
Solution of many of the problems depended on work that could be done 
only in the future. Future work is clearly implied in Composite B, Dis- 
cussing before Acting. One attribute of the principal’s work on in-basket 
items, especially of work to be done in the future, was the care with 
which he organized and scheduled his time. The principals displayed 
marked differences in the degree to which they attended to the problem of 
organizing their work for the future. Some set the date and hour of many 
of their future activities; others scheduled virtually none of their future 
work and provided little evidence that they had concerned themselves 
with when they would do work they planned for the future. 

Composite F was most clearly defined by the principals’ specific acts 
of scheduling work for some definite time in the future. The behavior 
covered by Composite F, however, is larger than the specific acts of 
scheduling work and includes other aspects of an organized and orderly 
approach to the handling of administrative problems. As has been 
shown in Chapter 7, such activities as following a pre-established pro- 
cedure and relating problems to background information are related. 
From the correlation of in-basket category scores with Composite F, the 
picture is rounded out by correlations with asking superiors or outsiders 
for information (r = .23 and r= .27), coordination (r= .21), and 
setting deadlines for the completion of work (r = .21). 

Concern about methods of instruction (r = .30), objectives (r = 
.25), teacher personality (r = .24), planning (r = .23), pupil moti- 
vation (r= .22), and pupil participation (r= .22) were expressed 
to a greater degree in their responses to the film by the principals 
earning higher Composite F scores. These principals also earned 
higher scores on the job performance values: employee personnel 
(r= .28), planning (r = .28), and instruction and curriculum (r = 
.20). They were identified by members of their respective groups as 
being more effective in decision making during the group interaction 
problemise( tis 22))E 

Those principals who organized their work in their in-basket per- 
formance also showed more organization in the speeches they delivered 
to the PTA: introduction (r = .28), organization (r = .27), conclusion 
(r = .23), and efficiency (r = .27). These principals also earned high 
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scores on the speech categories clarity (r= .22) and voice control 
(r = .24). 

High scores on Composite F tended to be earned by the same 
principals who scored high on the tests of professional and general 
knowledge: Administration and Supervision (r = .35), Elementary Ed- 
ucation (r = .31), and Social Studies (r = .29). Several of the tests of 
basic mental abilities yielded scores with positive relationships with or- 
ganization of work. These included number facility (r = .25 and r = 
.31), associational fluency (r= .28), inductive reasoning (r = .26), 
Speed of closure (r = .25 and r = .18), verbal knowledge (1 = .23), 
ideational fluency (r = .21), word fluency (r = .21), and general rea- 
soning (r = .21). High scores on Composite F tended to be earned by 
the principals who scored high on the background achievement tests: 
community (r = .32), educational program (r = .28), staff (r = .25), 
and funds and facilities (r = .21). 

The in-basket test scorers described those principals who earned 
high scores on Composite F as urbane (r = .37), resourceful (r = .33), 
painstaking (r = .31), logical (r = .28), tactful (rf = .27), wordy (tr = 
.27), and forceful (r = .24). There were no substantial correlations 
involving scores on the basic personality factors. Those principals scor- 
ing high on Composite F showed an orientation toward pupil educational 
needs (r = .22), but they displayed no particular pattern of interests in 
completing the Strong Vocational Interest Blank for Men. They were 
not characteristically either older or younger or more or less experienced 
than the low-scoring principals. 

In their ratings, superiors associated high oral communication skill 
(informal, r = .27; formal, r= .21), the ability to understand written 
communications (r = .22), and knowledge of administration (r = .20) 
with principals who scored high on Composite F. In-basket scorers 
considered these principals to be better qualified for the position of 
principal of Whitman School (r = .34). Neither the teachers’ descrip- 
tions of their principals’ behavior nor the ratings made by members of 
the research staff, however, showed a substantial relationship with these 
scores. 

Organizing work appears, in summary, to be characteristic of those 
principals who possess superior professional knowledge, who do better 
on tests of basic mental abilities, and who profited most from a study of 
the background material. Superiors and the in-basket test scorers rated 
these principals higher. Patterns of personality variables or interest 
measures did not differentiate principals who organized their work from 
those who did not. 
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COMPOSITE SCORE G: RESPONDING TO OUTSIDERS 

In his position as principal, Marion Smith was faced with constant 
pressures and demands of interested parents and other community mem- 
bers. This was a particularly prominent characteristic of the principal’s 
job at Whitman School. Many of the items in the in-basket test were 
requests for special consideration, complaints, or invitations to partici- 
pate in activities originating outside the school. A performance factor 
was found in the analysis of the in-basket scoring categories that is best 
interpreted as the degree of responsiveness shown by the principals to 
these outside pressures. 

Composite G, Responding to Outsiders, was defined largely by the 
principals giving information to outsiders, following suggestions or leads 
from outsiders, and showing courtesy in situations involving outsiders 
both as individuals (loading = .31) and as groups (r = .48). 

The principals who earned higher scores on Composite G also were 
rated higher on the selection and use of words in making their speeches: 
word usage (r = .24), clarity (¢ = .23), and pronunciation (r = .22). 

Principals showing a greater tendency to respond to outsiders dis- 
played greater concern for teacher personality (r = .24), child growth 
and development (r = .21), and curriculum (r = .20) in making ob- 
servations about probationary teachers. These particular concerns per- 
tain to characteristics of the probationary teachers’ work that are likely 
to be most visible to parents. 

In their reactions to the special educational problems (presented 
by tape recordings), the principals scoring high on Composite G showed 
greater concern with instruction and curriculum (r = .31), pupil per- 
sonnel (r = .27), employee personnel (r = .26), and planning (rf = 
.20). They showed no particularly distinctive characteristic in the group 
interaction situation. 

There were small but significant relationships between score on 
Composite G and the scores on the professional and general knowledge 
tests: Administration and Supervision (r = .28), Elementary Education 
(r = .26), Social Studies (r= .25). A small number of the basic 
mental ability test scores were also positively related to responding to 
outsiders. These included associational fluency (r = .28), number fa- 
cility (r = .24 and r = .25), verbal knowledge (r — .23), flexibility of 
closure (r = .23), general reasoning (r = .23), visualization (r = .22), 
and deductive reasoning (r = .22). Principals scoring higher on Com- 
posite G tended to earn higher scores on the organization subsection of 
the achievement test that was administered after study of the background 
material (r = .20). 
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The in-basket scorers, in completing the Check List of personal 
qualities, described those principals who responded more to outsiders as 
eet 155) 1orceful (1 — 632) urbane; (r—=<31),\ tactful (r= 
mi yeecourteous (1 — .25), painstaking (r= .23), resourceful (r = 
m20),,and logical (r —=.20). 

No differences were found in the patterns of correlations of the basic 
personality factors with Composite G scores—all were approximately 
zero. Nor were any distinctions noted in the patterns of interest or 
orientation to the study of background material that could be associated 
with high-scoring principals. Age and experience also show no relation 
to Composite G. 

Although those principals who responded to outsiders were con- 
sidered better principals for Whitman School by the in-basket scorers 
(r = .41), neither superiors’ ratings, teachers’ questionnaire reports, 
nor staff members’ ratings were correlated with Composite G scores. 

Responsiveness to outside pressures seems to be more characteristic 
of the better-prepared principals. This variable in administrative per- 
formance is unrelated to evaluations made by superiors, teachers, and 
staff members, but it was considered by the in-basket test scorers as a 
desirable quality for a principal of Whitman School. From the data 
available, it cannot be determined whether a community reputation as a 
“sood principal” would relate to this factor in his work, but it seems 
reasonable to speculate that such might be the case. 


COMPOSITE SCORE H: DIRECTING THE WORK OF OTHERS 

Directing the Work of Others is the factor in administrative behavior 
that corresponds most closely to the stereotype of the administrator. It is 
this factor to which reference is commonly made when the school ad- 
ministrator is described as a “leader.” The area is a large one and in- 
cludes not only the direction of the work of his teachers but also the di- 
rection of school-related work performed by outsiders. 

Significant elements in the direction of work of others are showing 
courtesy to superiors (r = .25), giving recognition for good work (r = 
.25), and explaining to subordinates (r = .28). Other significant ele- 
ments appearing in Directing the Work of Others are coordination (tr = 
.24), setting deadlines (r = .35), and planning follow-up (r= .18). 
Directing the Work of Others requires immediate and direct responses 
to the in-basket problems. Principals scoring high on Composite H were 
those individuals who took positive and definite steps toward the solu- 
tion of the problem during the test period. 

In their speeches to the PTA, principals who were high on Com- 
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posite H tended to score high on all speech categories, especially effec- 
tiveness of introduction (r = .32) and word usage (r = .29). They dis- 
played concern about objectives (r = .24) and evaluation (r = .22) 
in their reactions to the probationary teachers. They showed no par- 
ticular concern in their responses to the special educational problems. 
They were judged by their fellow group members as more effective in 
presenting facts (r = .22), in making decisions (r = .20), and in hav- 
ing attempted to influence the group (r = .20) in the interaction situa- 
tion. 

Composite H scores are positively related to-scores on the profes- 
sional and general knowledge tests: Administration and Supervision 
(r = .28), Elementary Education (r = .22), and Social Studies (r = 
.26). Several of the basic mental ability tests also show a positive 
relationship with Directing the Work of Others: word fluency (r = .29), 
inductive reasoning (r = .27), ideational fluency (tr = .26), number 
facility (r = .22 and r = .25), speed of closure (1 — -23/andti = ae 
associational fluency (r= .24), and deductive reasoning (r= .20). 
High-scoring principals in this area also tended to score higher on the 
achievement test or the background materials—especially on the sec- 
tions concerned with funds and facilities (r = .23), community (r = 
.23), and the educational program (r = .22). 

In-basket scorers described the principals who did more Directing 
the Work of Others as forceful (r = .45), resourceful (r = .44), wordy 
(r = .44), urbane (r = .43), painstaking (r = .39), tactful (r = .30), 
courteous (r = .29), and witty (r = .21). The basic personality factors 
add no information about the principals who scored high on Composite H. 

The principals who scored higher on Directing the Work of Others 
displayed greater orientation toward community concerns (r = .22) 
and the educational needs of pupils (r = .21) during their study of the 
background materials. Their interests, as measured by the Strong Voca- 
tional Interest Blank for Men, however, did not differ appreciably from 
the interests of other principals. Neither age nor experience appear to be 
factors associated with the amount of directing the work of others that 
the principals displayed in their in-basket work. 

Composite H showed only small correlations with superiors’ ratings. 
Teachers’ reactions were independent of the scores on Composite H, as 
were staff members’ impressions of the principals at the end of the test 
week. In contrast, however, the in-basket test scorers gave favorable 
ratings to principals scoring high on Directing the Work of Others (r = 
2) 

It seems clear that Directing the Work of Others is associated with 
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a forceful and positive approach to administrative problems (e.g., the 
scorers’ ratings on the Check List of the attribute “forceful,” and con- 
cerns with “objectives,” “evaluation,” “planning,” etc.). Although 
forceful and positive action is involved, the low relationship of Composite 
H scores to the professional knowledge test scores and the ability test 
scores suggest that persons of lower ability do not hesitate to direct the 
work of others. 


FRAMEWORK FOR UNDERSTANDING ADMINISTRATIVE 
BEHAVIOR 


In the preceding sections, eight composite scores based on the factor 
analysis of performance on the in-basket tests have been described and 
their relations to other variables of the study presented. Each of the 
eight scores refers to a part of a total complex of administrative per- 
formance. It is the purpose of this section to show how the eight areas 
can be viewed within an over-all framework. The basic concepts on 
which to build this framework are provided by the results of the second- 
order factor analysis reported in Chapter 7. The specific task here is to 
show how the two basic concepts suggested by that analysis can provide 
a way of viewing administrative performance as a unified, although com- 
plex, pattern of performance. 

The two second-order factors were identified by the concepts, Prep- 
aration for Decision vs. Taking Final Decisions and Amount of Work 
Expended in Handling the Items. Both of the concepts need further 
discussion and development. As a first step, data presented in Table 25 
and Table 26 have been rearranged in Table 91 to make clear the rela- 
tionships among three distinguishable components of each of the eight 
primary factors? in administrative performance. Two of these parts are 
Amount of Work (Factor Y) and Preparation for Decision vs. Taking 
Final Decisions (Factor X); the third corresponds to the unique content 
of the factor in question. It is important to recognize clearly that one 
of these components, Preparation for Decision vs. Taking Final Deci- 
sions, involved a bipolar concept. On one end of a continuum defined 
by this factor is preparation for decision, on the other is decision and 
action. Unlike Amount of Work, which ranges from no work done (0) 
to a large expenditure of effort (+), Preparation for Decision ranges 
from making many preparations for deciding (-+-) through the zero point 
(0), to taking final action (—). 


* These three components are identical with three of the four components of 
the composite scores (see page 266). 
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From data presented in Table 91, it is possible to obtain a more 
complete understanding of each of the eight factors in performance than 
is possible by considering each factor individually. For example, the 
total variance of Exchanging Information is made up of 44 per cent 
attributable to Preparation for Decision, 29 per cent attributable to 
Amount of Work, and 27 per cent to unique content. Maintaining Rela- 
tionships involves an even larger amount of work (40 per cent Factor Y ) 
in addition to unique content, but is independent of Factor X. Analyzing 
the Situation is largely independent of both Amount of Work and Prep- 
aration for Decision. 

This framework permits us to consider each course of action as a 
response that is generated by expenditure of energy (amount of work) 
in a decision-to-act process and that is expressed in a manner describa- 
ble by reference to one or more of eight factors. In terms of this frame- 
work and with reference to the data of Table 91, it is possible to obtain 
a relatively comprehensive understanding of the administrative perform- 
ance of principals. The framework also makes it possible to understand 
some of the relationships between the eight factors in administrative per- 
formance and the measures of knowledge and ability. 

The work of the principals in the in-basket test situations was 
largely the production of written material. Administrative performance, 
however, cannot be directly equated with number of words written. 
The eight factors in performance required differing amounts of writing. 
Maintaining Relationships, Exchanging Information, and Directing 
Others imposed higher requirements for written work than did other 
factors. These three factors were the ones in which higher correlations 
between composite scores and scores on the word fluency test were 
observed (r’s for these three were .33, .41, and .29, as compared with 
.26, .08, .15, .21, and .20 for the remaining five). Although the rela- 
tionship is not perfect, principals who possess greater fluency in the use 
of words do score higher in the areas of administrative performance in 
which high work output is required. 

The other major aspect of the framework is the concept of Prepara- 
tion for Decision vs. Taking Final Action (Factor X). Well-accepted 
theories of administration consider administration as decision making, 
and the findings of this study add much to support such general the- 
ories.2 The continuum between Preparation for Decision and Taking 
Final Action refers to the stage of development an administrative decision 

*In particular note Herbert Simon, Administrative Behavior (New York: 


Macmillan, 1959) and Daniel E. Griffiths, Administrative Theory (New York: 
Appleton-Century-Crofts, 1959). 
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has reached at any given time. Some principals characteristically be- 
have in a way that places them near one end of the continuum, while 
others typically perform in a manner described by another part of the 
continuum. Each principal’s performances can be located at some 
point on the continuum with respect to the way he typically worked in 
solving his problem. This statement should not tempt one to equate 
good administration with taking final action on all items. Final disposal 
of many problems need not be an index of the quality of performance. 

It is helpful in understanding this bipolar concept to identify various 
stages in the development of a decision toward final action and to place 
some of the in-basket scoring categories along such a developmental 
continuum. The schema presented in Table 92 suggests six stages in 
the development of decision toward action and presents some scoring 
categories associated with each stage as indicated by their saturations 
on Factor X. 

The concept of Preparation for Decision vs. Taking Final Action 
(Factor X) is a generalization about an abstract property of administra- 
tion. No implications are involved about how individuals proceed to 
make a decision in solving an administrative problem. They may or 
may not go through each of the six stages suggested in Table 92. It is 
very likely, in fact, that in some instances some of the stages will be 
omitted entirely. An individual may decide and act on a problem with- 
out showing evidence of having worked at any specific one of the stages. 

It is possible, however, to describe a principal’s administrative per- 
formance by reference to the stage of the decision-to-action process at 
which he typically worked as he handled the items contained in an in- 
basket test. The principals differed in the number or proportion of prob- 
lems that they handled at each stage between the early recognition of a 
need to prepare for decisions and taking final action on problems. 

Evidence will be presented in the next chapter suggesting that those 
principals with more professional knowledge (of both teaching and ad- 
ministration) and those scoring higher on the basic ability tests acted 
in such a way as to remain at a relatively early stage on the continuum 
from preparing for decision to taking final action. They apparently 
recognized more of the problems as requiring more information, dis- 
cussion, or analysis than could be brought to bear on them in the short 
time available. They preferred to concern themselves during the test 
period with the organization of work for the future, planning discussions 
with others, or seeking more information. 


Chapter 13 


COMPONENTS OF 
ADMINISTRATIVE PERFORMANCE 


IN THE PRECEDING CHAPTER, THE RELATIONSHIPS BETWEEN COMPOSITE 
scores for eight in-basket test factors and a large number of measures 
from other parts of the study were presented. The relationships between 
these composite scores and other variables were examined, one at a time, 
by the simple expedient of correlating the scores with the other variables. 
This chapter will provide information about the relationships of the 
basic components of the factors to other measures as they are revealed 
by analysis of patterns of relationship among larger groups of variables. 


UNIQUE COMPONENTS OF FACTORS 


It is necessary to distinguish between the composite scores discussed 
in the preceding chapter and the components of the factors which are 
to be the major concerns of this chapter. Composite scores, it will be 
recalled, were obtained by adding together category scores which were 
selected on the basis of their loadings on the eight primary factors 
(Chapter 7). Components of the performance factors, in contrast, are 
obtained by an analytic division of the variance of the factors into dis- 
tinguishable parts. 

Perhaps an analogy would be useful as a means of distinguishing 
between the composite factor scores used in the preceding chapter and 
the unique components of factors that are to be examined here. In ele- 
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mentary chemistry,! distinctions are made between mixtures, com- 
pounds, and basic chemical elements. A mixture is composed of any 
convenient collection of compounds; in-basket scoring categories, by 
analogy, may be considered mixtures. Most of our experience with the 
chemical world is with mixtures; the more purely constituted compounds 
are generally produced by more or less elaborate chemical processes. 

The factor analysis described in Chapter 7 was a process by which 
the complicated mixtures embodied in each of the scoring categories 
were separated into more uniform factors or, by analogy, compounds. 
The composite factor scores were obtained by combining scoring cate- 
gories in such a way as to concentrate a particular factor (compound). 
These composite scores are mixtures, but they represent a concentration 
of a particular factor. 

The unique components of a factor, by analogy, are elements. Each 
of the eight in-basket factors is either a three-element or two-element 
compound. It is composed of a unique element for each factor and one 
or two other elements that enter into each compound; these latter ele- 
ments are the second-order factors. The unique element is the part of 
the factor which is left after removing both second-order factors. Thus, 
with due allowance for the hazards of reasoning by analogy, there is 
little more reason to expect Composite Factor A and the unique ele- 
ment of Factor A to be alike than to expect to find the same qualities in 
salt (NaCl) and chlorine. 

In the analysis to be reported here, relationships of the unique ele- 
ments of the factors to other variables of the study may be quite differ- 
ent from the relationships of composite scores to these other variables. 
It has been shown (Table 91) that each of the eight in-basket perform- 
ance factors is complex in the sense that it is made up of one part 
which is unique to the specific factor and a second part which is shared 
with other factors. This second part determines the correlation between 
the eight factors. It has been divided into two second-order factors— 
Amount of Work and Preparation for Decision. The correlations be- 
tween composite scores and other variables, discussed in the preceding 
chapter, involve all this complexity, with the primary and second-order 
factors completely confounded. 

Similar complexity characterizes, in varying degrees, the 165 other 
measures with which the eight composite scores were correlated. This 


*Reasoning by analogy is at best subject to severe limitations. Factor 
analysis and chemical analysis, of course, differ in many important respects. See 
Lee J. Cronbach, Essentials of Psychological Testing (New York: Harper & 
Brothers, 1949), pp. 208-209. 
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complexity has been shown for some of these measures in other sections 
of this report (for example, see Chapter 11 for the analysis of the char- 
acteristics of superiors’ ratings) and by previous research such as that 
on the Strong Vocational Interest Blank for Men,* the ability tests,*? and 
the personality factors. The analysis presented in this chapter will 
supplement that of Chapter 12 by providing information about the rela- 
tionships between the various components of the in-basket test factors 
and a selected set of the other measures. 

The 120 variables selected for this analysis consisted of 32 of the 
68 in-basket scoring categories, 15 of the 16 basic mental abilities, 14 
of the 16 basic personality factors, 12 of the 13 superiors’ ratings, 11 
of the 12 categories of instructional awareness, eight of the 10 group 
interaction categories, the six scores for the categories of job perform- 
ance values, five Strong Vocational Interest Blank for Men scores, 
the four scores from the professional and general knowledge tests, two 
of the background orientation categories, the three teachers’ question- 
naire scores, the background achievement test total score, the in-basket 
scorers’ rating, the staff over-all rating, and five items of biographical 
information. The 120 variables selected are shown in the first column 
of Table 94. 

Twenty-six of the in-basket categories that were used in the original 
factor analysis of the in-basket scores are included. Twenty-two of 
these were used to obtain the composite scores reported in Chapter 12. 
The remaining six categories were selected because of special interest 
in their relationships with other variables. 


FACTOR ANALYSIS 


Intercorrelations among the 120 measures were obtained as the 
first step of the analysis. The resulting matrix is not reported here be- 
cause of its large size and because many of the correlations among the 
measures have already been presented. The highest correlation of each 
measure with another of the 119 measures was used as an estimate of 
its communality. The characteristic roots and vectors of the 120 « 120 
matrix were obtained, and the loadings of the 120 measures on 28 


*Edward K. Strong, Vocational Interests of Men and Women (Stanford 
University, Calif.: Stanford University Press, 1943). 

* Philip E. Vernon, The Structure of Human Abilities (London: Methuen & 
Co., Ltd., 1950). 

*Raymond B. Cattell, Personality and Motivation Structure and Measurement 
(Yonkers-on-Hudson, N.Y.: World Book Company, 1957). 
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TABLE 93. Characteristic roots of largest 28 factors 


Factor 
Order Root Decrease 

I l73 

II 6.67 11.06 
Ill 6.43 24 
IV 4.07 2.36 
Vv 3.58 .49 
VI 3.48 .10 
VII 3.04 44 
VII 2.81 23 
IX 2.48 Bs) 
xX 2.40 08 
XI 1.95 45 
XII Hits) 20 
XII 1.66 09 
XIV 1653 13 
XV 1.40 13 
XVI 1.32 08 
XVII 1227 05 
XVIII 1.16 11 
XIX 1.09 07 
XX .99 10 
XXI 95 04 
XXII 90 05 
XXIII 84 06 
XXIV 79 05 
XXV 78 01 
XXVI 74 04 
XXVII 68 06 
XXVIII 65 03 


orthogonal factors were determined.’ The characteristic roots of these 
28 factors are listed in Table 93 in order of their magnitude. There is 
no obvious break in the rate of decrease of the size of roots to clearly 
suggest retaining any specific number of factors. Table 94 presents the 
orthogonal factor loadings of each of the 120 variables on the 10 largest 
factors. 

A question of great interest is that of the relative contributions of 
the three major components of the in-basket factors to the correlations 
between these factors and the other variables used in the study. As 

* The computations were carried out by the Littauer Statistical Laboratory at 


Harvard University. Appreciation is expressed to Mr. Robert Hoods, who 
planned and supervised the work. 
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was indicated at the beginning of this chapter, these relationships can 
be assumed to be complex and not clearly revealed by inspection of 
simple correlations between pairs of variables. Insight into the nature 
of these complex relationships can be obtained, however, by examining 
the correlations between the variables and the reference vectors that 
are determined by the oblique factor structure of the in-basket test per- 
formance. The data contained in Table 94 were used as a basis for an 
examination of these more detailed relationships. 

Twenty-six of the 40 in-basket test scoring categories used in the 
analyses presented in Chapter 7 were also included in the 120-variable 
factor analysis. The category scores, however, differed from those de- 
scribed in Chapter 7 by being based on the principals’ performances on 
only the three school in-basket tests, the Bureau of Business In-basket 
Test being omitted. A transformation matrix was computed® by which 
an orthogonal factor matrix composed of the first 10 factors (Table 94) 
was rotated to a factor matrix with eight oblique factors and having a 
factor structure for the 26 common in-basket categories as near as pos- 
sible (by a least-squares solution) to that obtained for these same cate- 
gories in the original analysis. 

The transformation was limited to the first 10 of the 28 factors 
from the 120-variable analysis, primarily to avoid possible difficulties in 
obtaining the inverse of the matrix required in the computations. One 
effect of this limitation was to reduce the common factor variance of 
each of the 26 category scores by an amount equal to the sum of the 
squares of loadings on the remaining smaller factors. Table 95 shows 
the communality of each of the 26 category scores within each of two 
factor spaces: (1) the eight-factor space in the original analysis of 40 
category scores, and (2) the 10-factor space of the 120-variable anal- 
ysis. 

The communality of all of the category scores was larger in the 
original analysis than in the 120-variable analysis. This is in part at- 
tributable to the fact that only the 10 largest factors were retained from 
the 120-variable analysis. In part it also is due to the fact that scores 
based on four in-basket tests are likely to be somewhat more reliable 


*Ledyard R Tucker suggested a procedure for computing the desired trans- 
formation matrix. This involved the following: 
Tp CE eer Vip 
where T, = the transformation matrix. 
F; =the matrix of the factor loadings for the 26 categories in the 120- 
variable analysis that are to overlap those from the original analysis. 
Vs» = the matrix of loadings for these 26 categories as given by the original 
analysis of 40 in-basket scoring categories. 
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TABLE 95. Communalities of 26 in-basket categories in two spaces 


Communalities 
In-basket Category ORIGINAL 
8-FACTOR 10-FACTOR 

Asks Subordinates .68 .48 
Informs Subordinates Sy, .46 
Discusses with Subordinates 86 .76 
Communicates Face to Face .88 9 
Decides on Procedure .85 el 
Concluding Decision .87 .63 
Follows Subordinates .68 .40 
Terminal Action 82 .64 
Program Values git) 54 
Conceptual Analysis 80 .64 
Superiors Involved .46 yl! 
Discusses with Superiors Be) eh 
Outsiders Involved .70 .49 
Relates to Other Materials 53 36 
Immediate Work Scheduled .69 .45 
Intermediate Work Scheduled ey! 932 
Informs Outsiders .48 e352 
Follows Outsiders 54 .46 
Courtesy to Outsiders 43 24 
Leading Action .87 v1 
Courtesy to Subordinates By oD 
Directs .83 ATA! 
Careless pepe .20 
Delays 24 .20 
Informality to Subordinates oil 28 
Number of Words .80 74 

Total 16.61 12.84 


than those based on only the three school tests. Perhaps of more sig- 
nificance, however, is the elimination of 14 of the 40 in-basket scoring 
categories that were used in the original analysis. The additional 14 
categories probably introduced variance which did not appear in the 
120-variable analysis but which in the original 40-category analysis was 
shared with one or more of the remaining 26 categories. 

The transformation matrix was first normalized by column and then 
employed to compute the correlation of each of the 120 variables with 
eight oblique reference vectors, each vector corresponding to one of 
the eight factors found in the original analysis of 40 in-basket 
scoring categories. These correlations provided a means of examining 
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TABLE 96. Normalized transformation matrix 


Factor a B’ C D' E’ Jet Cr H’ 


I —44 —01 —02 —.03 —17 —.03 .06 1g 
I —.48 30 SPs) 33 —.20 27 —28 —.12 
Ill 11 .O1 PL), O1 O07 —25 —52 —.26 
IV —.11 O01 —.23 39 —0l —17 —48 .10 
Vv Pas 10 —12 —27 —.18 05 25 —.60 
VI —.02 .—12 —.30 —.24 aL Ee, ag Ye 04 
VII 25 —.79 16 04 —.05 45 —55 —.39 
Vill 55 —43 —.20 40s) 12.. —.56 04 —.03 
IX —.06 —.08 00 —18 —.54 Me) 20 59 


X 36 —28 16° 76 —28 (5 


the basic relationships between the components of in-basket factors 
and the other measures included in the study. They are the correla- 
tions of the variables with these reference vectors and may be interpreted 
as proportional to the correlation of the variable with the unique part 
of the corresponding factor. For convenience these values will be re- 
ferred to as estimated loadings on the unique component of the primary 
factors, or more succinctly as loadings on estimated factors. 

These loadings on the estimated factors are not equivalent to the 
estimates of loadings on the original factors which might have been ob- 
tained if a different and more conventional procedure for factor exten- 
sion had been employed.’ Somewhat different estimated loadings also 
would have been obtained if all 28 rather than the largest 10 factors 
had been used in the analysis. These coefficients cannot be interpreted 
directly as correlation coefficients between the variables and the original 
factors. However, the pattern of relationship suggested by them can 
lead to specific hypotheses with respect to the probable nature of rela- 
tionships between basic mental abilities, personality factors, interests, 
values, superiors’ rating, etc., and the in-basket performance of the 
principals. 

The normalized transformation matrix is given as Table 96. The 
columns of this transformation matrix are identified by A’, B’... H’ 
to indicate that they are not identical with the corresponding factors 
previously discussed (Chapter 7) but are special reference vectors. The 
position of these reference vectors is determined not by the entire 120 
variables but by the 26 in-basket scoring categories. The result of ap- 


™P. S. Dwyer, “The determination of factor loadings of a given test from the 
known factor loadings of other tests,” Psychometrika, 1937, 2, pp. 173-178. 
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TABLE 97. Intercorrelations among estimated factors 


Factor A’ B’ CG. D’ E’ ee (Gr H’ 
A’ 1.00 73 11 45 08 69 —.24 Dy, 
B’ 73 1.00 —.26 36 —.04 70 —.45 36 
C’ 11 —.26 1.00 —.10 42 —.25 39 26 
D’ 45 36 —.10 1.00 15 20 iT 06 
E’ 08 —.04 42 oh 1.00 03 20 yan) 
jeu 69 70 —.25 .20 03 1.00 —.39 40 
G’ —24 —.45 39 Jee) 20 —.39 1.00 —.32 
H’ oe 36 26 .06 25 40 —.32 1.00 


plication of the transformation matrix will be presented after considering 
the correlation between the estimated factors. 

Table 97 presents the intercorrelations among the estimated factors 
A’ through H’. 

The size and the pattern of the intercorrelations among the esti- 
mated factors are very similar to that obtained for original first-order 
factors (see Table 24). This finding suggested the desirability of in- 
cluding estimated second-order factors in the analyses. 

The largest correlation with another of the seven factors was used 
as the estimate of each estimated factor’s communality. Characteristic 
roots and vectors were computed and the factor loadings on the two 
largest factors determined. The loadings are presented in Table 98, 
with the rotated factor loadings from the original analysis added for 
purposes of comparison. 

Comparison of the factor loadings of the estimated second-order 


TABLE 98. Second-order orthogonal factor matrix for estimated factors 


Estimated Factors Original Factors 
UNROTATED ROTATED ROTATED 
Factor xX’ LY Gs ae Vie h? x Yi h2 
A’ 85 26 .64 .62 .79 66844 73 
B’ 85 —.15 83 25 He vail 34 .62 
Cc  —.16 .68 —,45 yi! .49 —.47 38 aiL. 
D’ 35 19 22 33 16 oli 36 .16 
E’ .04 .60 —24 55 36 —.05 .63 .40 
F’ 81 —.11 78 7 .68 .78 .16 .63 
G —.46 ED —.60 a1; 39 —.63 .08 .40 


H’ wl 36 34 8.58 .46 46) 45 41 
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factors with those from the original analyses shows very close corre- 
spondence. The saturation of each of the 120 variables with these two 
estimated second-order factors (X’ and Y’) was determined and will 
be presented and discussed along with their loadings on the estimated 
primary factors (A’ through H’). 


ESTIMATED FACTOR LOADINGS 


In this section the factor matrix for the eight estimated factors and 
26 in-basket variables of the study will be presented. These are the 
26 in-basket categories used in the determination of the rotation of the 
reference axes. These categories are arranged in the upper section of 
Table 99 in order of their assignment to the composite factor scores A 
through H; to facilitate examination, the loadings for each composite 
are in boldface type. There is a total of 208 (26 x 8) loadings to be 
considered. 

The loadings marked with asterisks were +.20 or larger in the 
original oblique factor matrix. Of the 43 loadings in Table 99 which 
are so marked, only six are below + .15 in value. Only eight of the 
remaining 165 loadings, which were not as large as + .20 in the original 
analyses, exceed + .15 in Table 99. Although the effect of reduction 
in the common factor variance discussed earlier is quite apparent in the 
size of the loadings in Table 99, the match between the relative size of 
loadings on the factors is very satisfactory for all of the factors except E. 

The degree of correspondence between the original factors and the 
estimated ones was examined by use of a salient variable similarity 
index described by Cattell. The four categories with highest loadings 
for each factor were matched with the four highest loaded categories 
for the respective estimated factors; three of the four were found to 
match or overlap for nine of the 10 factors. The chance probability of 
overlap of three of the four salient scoring categories is far less than 
one in a hundred. The overlap (one category) in the case of Factor E 
raises some doubt about the similarity of the original and the estimated 
Factor E’. 

The purpose served by the 26 categories of Table 99 in this analysis 
is that of establishing a frame of reference from which the basic relation- 
ships between factors of administrative performance and the other meas- 
ures of the study can be examined in detail. The frame of reference 
consists of the unique components of the eight primary factors and two 


* Raymond B. Cattell, op. cit., pp. 818-825, 


re ne 
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second-order factors. This frame of reference is now extended to other 
measures of the principal’s ability, personality, past performance, and 
behavior in the simulated school. 


RELATIONSHIPS TO ESTIMATED FACTORS 


In this section the loadings of a large number of variables on three 
components of the estimated primary factors will be discussed. The 
components are the unique part of each of eight primary factors, second- 
order Factor X, and second-order Factor Y. 


ESTIMATED FACTORS AND IN-BASKET CATEGORY SCORES 


Six of the 32 in-basket category scores were not included in the 
original factor analysis reported in Chapter 7 and, of course, were not 
involved in the estimation of the factors. They were included in the 
intercorrelations with the hope that they might contribute to the under- 
standing of one or more of the factors. 

The correlations of these category scores with the composite scores 
reported in Table 89 suggested that Recognition of Good Work might 
be an important part of Exchanging Information (Factor A) or Discuss- 
ing with Others before Acting (Factor B). The category Prejudges was 
included because of the possibility that the category of performance 
might add to the understanding of the second-order Factor Y, Prepara- 
tion for Decision. The category Human Values seemed also to be re- 
lated to Analyzing the Situation (Factor D). It appeared that the dele- 
gation categories and Sets Deadline might illuminate the nature of 
Factor H, Directing the Work of Others. 

The information yielded by this analysis of additional in-basket 
categories was not entirely in the directions expected. (See the lower 
section of Table 99.) Recognition of Good Work appears to be an ex- 
pression of the second-order factors (L=.28 and .31),® not of 
Exchanging Information (L=.13) or Discussing before Acting 
(L = .07). The correlations noted in the analysis with composite scores 
are apparently produced at the second-order level. This also appears 
to be the case for the relationship noted between Factor D’ and Human 
Values. 

The two delegation scores did appear with clear loadings on Factor 
H, as had been expected (L = .25 and .34). Delegation in the in-basket 
test performance of the principals is apparently best understood as a 


°In discussing the results of this section “L” will be used as an abbreviation 
for estimated factor loading. 
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technique for giving work to others. The category Sets Deadline did not 
load as highly on Factor H’ (L = .19) as had been expected from the 
correlations with the composite score for Factor H’. The category 
Prejudges showed the expected negative loading on the second-order 
Factor Y’ (L = —.19) and also a small positive loading on Factor H’ 
(L = .24). The interpretation of Factor H as involving a certain 
amount of carelessness and lack of perceptiveness will be developed in 
greater detail as relationships of this factor with other measures are 
presented. 


ESTIMATED FACTORS AND MENTAL ABILITY, KNOWLEDGE, AND 

ACHIEVEMENT TESTS 

The second part of the estimated factor matrix to be discussed con- 
tains the loadings of the various tests of basic mental abilities and of 
professional and general knowledge and the background achievement 
test. Table 100 presents this section of the factor matrix, together with 
the saturation of each measure with the estimated second-order factors. 

The unique part of Factor A’, Exchanging Information, is clearly 
related to facility in the use of words and language. The substantial 
loadings on the tests in professional and general knowledge areas, espe- 
cially knowledge of teaching (L = .42), may indicate that sharing in- 
formation depends on an adequate professional background. The inter- 
pretation of the high loadings on the two number facility tests (L = .43 
and .40) is not obvious. These tests are usually regarded as measures 
of the Number factor. “A Factorial Study of Number Ability” by 
Coombs,!° however, suggests that the factors measured by the tests re- 
flect a more general ability in the manipulation of a symbolic system ac- 
cording to well-learned rules. In in-basket performance the symbols may 
be words having well-defined special meanings in professional education 
(e.g., the “self-contained classroom,” the ‘“‘whole child’’). 

The unique part of Factor B’, Discussing with Others before Acting, 
does not appear to be a type of performance that depends on the abilities 
and knowledges measured by the tests included in Table 100. The load- 
ings on Factor B’ are not large enough to warrant an attempt at interpre- 
tation. 

It will be recalled that the composite score for the area Complying 
with Suggestions (Factor C) was noteworthy (see Chapter 12) because 
it did not correlate significantly with most of the other measures. In this 
analysis, where it is possible to examine the unique part of Factor C’, a 


*° Clyde H. Coombs, “A Factorial Study of Number Ability,” Psychometrika, 
1941, 6, pp. 161-189. 
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number of abilities appear to be involved. The abilities concerned are 
reasoning, especially general and deductive (L = .49 and .48), visuali- 
zation (L = .46), and flexibility of closure (L = .47). Compliance also 
appears to be associated with knowledge in the general areas of science 
and mathematics (L = .48), but not necessarily with knowledge of ad- 
ministration (L = .15), or elementary education (L = .12). Following 
suggestions made by others, therefore, appears to be a pattern of be- 
havior that is associated with reasoning. Those principals who comply 
or follow suggestions made by others appear to do so in recognition of 
the merit of the suggestions. There is certainly no evidence in these data 
that would support an interpretation of the unique part of Factor C as a 
reflection of low general mental ability. In addition, the relationship of 
the unique part of this factor with the total score on the background 
achievement test (L = .37) suggests that the principal who solves his in- 
basket problems by following suggestions has superior learning ability, 
which he uses to compensate for lack of professional knowledge. 

Factor D’, Analyzing the Situation, like Factor C’, shows positive 
relationships with the ability tests measuring general and deductive 
reasoning (L = .24 and .34). This is support for the interpretation of 
Factor D’ as a type of broad analysis of administrative problems. 

The test scores show a mixed pattern of very small positive and a 
few small negative loadings on Factor E’, Maintaining Organizational 
Relationships. The small negative loadings tend to be on those tests 
that were positively loaded for Factors C’ and D’. The general lack of 
strong relationships is even more true for Factor F’. Apparently the 
abilities and knowledge measured by the tests have little relationship to 
the unique parts of these two factors. 

The ability test scores are generally negatively loaded on both 
Factors G’ and H’. The pattern of loadings on the two factors is very 
similar. The tests of professional and general knowledge and general 
reasoning have the higher negative values (loadings range between —.11 
and —.36). There is a definite suggestion that low general ability and 
lack of knowledge may result in the tendency of principals to be respon- 
sive to outsiders (Factor G) and to be directive in their work with others 
(Factor H). 

The loadings of the ability, professional, and achievement tests are 
positive on both second-order factors, Preparation for Decision (X') 
and Amount of Work (Y’). The pattern of loadings on the two factors 
is rather similar. Loadings tend to be somewhat larger for Factor Y’, 
except for speed of closure, associative memory, Administration and 
Supervision, and Elementary Education; but the differences are very 
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small between the two factors. On the other hand, several tests are 
distinctly higher on Factor Y’ than on Factor X’. These include tests of 
verbal knowledge (L = .24 and .33), word fluency (L = .26 and .39), 
deductive reasoning (L = .13 and .28), general reasoning (L — .16 
and .34), and number facility (L = .21, .25 and .38, .40). Amount of 
Work appears to entail a fluency, speed, and facility in the manipulation 
or production of symbols. Preparation for Decision is perhaps more 
closely identified with ability to see order and relationships in loosely 
organized materials. 


ESTIMATED FACTORS AND PERSONALITY, ORIENTATION, AND 

INTEREST TESTS 

The third panel of scores from the larger group of measures to be 
considered is presented in Table 101, which includes three types of 
variables: 15 basic personality factors, two background orientation 
categories, and five Strong Vocational Interest Blank for Men scores. 

It will be recalled that the basic personality factor scores did not 
show interpretable relationships with many of the composite scores in 
the analysis presented in Chapter 12. The analysis reported here, how- 
ever, contains relationships with the unique parts of factors in in-basket 
test performances which add substantially to the understanding of the 
principals’ performance in the in-basket test situations. 

The discussion of these relationships with the basic personality factor 
scores is based on the research literature which is available concerning 
the factors measured by the Sixteen Personality Factor Questionnaire. 
The reader who may wish to check, reconsider, or further explore the 
interpretations presented here is referred to the extensive body of previ- 
ous research in which the Sixteen Personality Factor Questionnaire has 
been employed. 

The majority of the personality factors involved are bipolar; that is, 
they have meaning both in a positive and a negative sense. Both positive 
and negative loadings in Table 101 are of equal importance and both 
add to the understanding of relationships. 

Factor A’ has been identified as Exchanging Information. Personal- 
ity characteristics that appear to be involved in this type of adminis- 
trative activity include (A) friendliness, agreeableness, and social 
responsiveness (L = .21); (C) emotional sensitivity or, perhaps, tender- 
mindedness (L = .34); (L) understanding, trustfulness, and calmness 
(L = —.30); (M) individualism (L = .23); (O) self-confidence (L = 
—.21); and (Q,) freedom from fear and anxiety (L = —.21). In- 
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terest patterns as revealed by the five Strong Vocational Interest Blank 
for Men scores show similarity with those of city school superintendents 
(L = .36), lawyers (L = .29), and psychologists (L = .27), but defi- 
nitely not of policemen (L = —.45). The total picture is that of 
readiness to relate with others in an accepting and noncritical manner. 

Factor B’ entails discussing problems with others before administra- 
tive action is taken. Personality characteristics related to this factor are 
(C) emotional stability (i.e., not easily annoyed or frustrated) 
(i= 25); (O) self-confidence (L = .28); and (Q,) freedom from 
fear or anxiety (L = —.30). There are some small indications of 
similarity in interest to policemen (L = .27) and public administrators 
(L = .20). The total impression is that of a tendency to resist becom- 
ing excited or pressured into taking premature action by the mere exist- 
ence of a problem. 

Factor C’ has been identified as Complying with Suggestions Made 
by Others; as has been indicated in the discussion of ability measures 
the factor seems to imply reasoned or deliberate decisions to follow 
suggestions, rather than weak responses. This insight is supported by 
the relationship between Factor C’ and the basic personality factors. 
Personality characteristics related to Factor C’ include: (A) aloof steadi- 
ness of purposes (L = —.29); (H) careful considerate seriousness 
(L = —.26); (1) independent logical practicality (L = —.21); (L) 
skeptical suspiciousness (L = .36); (Q:) independence and self-suffi- 
ciency (L = .20); also included are (O) insecurity or feeling of in- 
adequateness (L = .25); (Q3) willingness to give in or compromise 
(L = —.29); and (Q,) considerable anxiety in response to pressures 
(L = .39). It would seem unlikely that a person possessing character- 
istics as indicated here would comply with a suggestion before he had 
given it close scrutiny, but he could and would comply if the suggestion 
passed the test of his reasoning. 

Analyzing the Situation (Factor D’) is indicative of a perception of 
the long-range or broad ramifications of specific administrative problems. 
Personality characteristics associated with high performance in this area 
include: (A) aloof and subjective steadiness of purpose (L = —.28); 
(E) superior aggressiveness or dominance (L = .30); (I) tough practi- 
cal independence (L = —.28); (N) insightful, shrewd thinking (dis- 
like for nonsense) (L—.30); and (Qs) some discontentment or 
anxiety related to feeling of pressure or conflict (L = .22). Interests 
show some similarity with policemen (L = .30) or public administration 
(L = .28). The general impression created by this constellation of 
personality characteristics is that of an individual with the inner capacity 
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and disposition to take a searching look at a problem and “let the chips 
fall where they may.” 

Factor E’, which was interpreted as Maintaining Organizational 
Relationships in the original analysis, was not as well estimated in this 
analysis as were the other seven factors. This factor perhaps should be 
viewed as a tendency or need to involve others, especially superiors, in 
making decisions. Personality characteristics that relate to this factor 
are: (A) friendly sociable responsiveness (L = .51); (F) lively, im- 
pulsive enthusiasm (L = .29); (H) bold, warmhearted spontaneity 
(L = .50); (1) kind, dependent, tender-mindedness (L = .22) coupled 
with (O) accepting self-confidence (L = —.35); (Q2) lack of resolu- 
tion or lack of ability to make up one’s mind (L = —.21); and (Q,) 
freedom from worry and anxiety (L = —.30). Interests show some 
similarity to those of city school superintendents (L = .45) or lawyers 
(L = .26) but not policemen (L = —.26). The general picture is that 
of a gay, agreeable, and spontaneous individual who functions in an or- 
ganization without serious personal application to the content of admin- 
istrative problems. 

Factor F’, Organizing Work, is defined to a large extent by the 
degree to which principals scheduled work they planned to do in the 
future. The emphasis is on establishing order in work to be done. The 
personality characteristics associated with this factor clearly indicate this 
need for orderliness. They include (C) lack of tolerance for frustration 
(L = —.36); (G) conscientiousness, a feeling of sense of duty or 
responsibility (L = .21); (H) a feeling of a need to be serious, careful, 
and considerate (L = —.33); (L) suspicious distrust (L = .45); (O) 
insecurity, worrying (L = .55); (Q3) being easily rattled or excited 
(L = —.32); and (Q,4) nervous anxiety (L = .60). Interests are not 
similar to those of psychologists (L = —.32), public administrators 
(L = —.29), or city school superintendents (L = —.38). It appears 
that the in-basket tests for these principals present a threatening, dis- 
orderly set of problems in which some order must be introduced by a 
rather compulsive preparation of a schedule of work. 

The relationship of the personality factors with Factor G’, Respond- 
ing to Outsiders, helps clarify the nature of this factor in the in-basket 
work. It is necessary, however, to recall the general lack of relationship 
between Factor G’ and the ability tests and also to anticipate a finding 
to be discussed later. 

Table 102 will show a positive association between Factor G’ and 
six of the categories of instructional awareness. Concerns or awareness 
expressed in evaluating the probationary teachers include the categories 
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Objectives, Evaluation, Planning and Continuity, Curriculum, Pupil Par- 
ticipation, and Pupil Motivation. The finding suggests that responsive- 
ness to outsiders may entail a deep interest in the primary purposes of 
education. It should be noted that these are concerns with such purposes 
or awareness of them, but not necessarily skills in achieving them. 

Returning to the personality characteristics related to Factor G’, 
Table 101 indicates that the following are associated with Responding to 
Outsiders: (E) submissiveness, meekness, modesty, obedience (L = 
—.37); (F) desurgency, indicating perhaps a sober commitment to 
long-term goals involving a subdued or even gloomy prospect for achiev- 
ing satisfaction through their attainment (L = —.32); (H) shyness and 
timidity (L = —.23); (N) simple sentimental naiveté (L = —.35); 
(Q3) persistence and stable interests (L = .22); and (Qs) composed 
nonanxious response to pressure (L = —.22). Strong Vocational In- 
terest Blank for Men scores are indicative of a lack of similarity in 
interest with those of public administrators (L = —.32) or lawyers 
(L = —.26). 

If we consider together (1) the pattern of personality factors and 
interests noted above, (2) the concern with the purposes of education, 
and (3) the fact that Responding to Outsiders is most characteristic 
of older women principals with longer backgrounds of experience in 
education (see Table 103), the nature of responsiveness to outsiders 
becomes more apparent. The simplest and perhaps overstated explana- 
tion is that such responsiveness is a result of a deep-seated and long 
commitment or dedication to the basic objectives of professional educa- 
tion. 

Directing the Work of Others (Factor H’) shows a small relationship 
with two of the personality factors. These give some indication that di- 
recting the work of others in performing in-basket tasks is associated 
with (F) sober desurgency or retiring from immediately satisfying goals 
(L = —.21) and (Qs) persistent self-control or will power (L = .26). 
This factor is not illuminated particularly by its relationship to personal- 
ity scores. The two small negative loadings on the Strong Vocational 
Interest Blank for Men score for city school superintendents and lawyers 
do not add to the picture. 

The loadings of the scores for the basic personality factors on both 
of the second-order factors are small and uninterpretable. The only 
loadings of possible interest are the background orientation score Pupil 
Education (L = .27) and the Strong Vocational Interest Blank for Men 
scores for psychologists (L = .22) and lawyers (L = —.21) on Factor 
X, Preparation for Decision. These loadings suggest that the principals 
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who preferred to work at the preparation stages in the decision process 
are more oriented toward, or are more interested in people, their prob- 
lems, and their needs than are principals who more often take final 
action. 


ESTIMATED FACTORS AND PROFESSIONAL CONCERNS 


The fourth section of the 8 < 120 factor matrix consists of two sets 
of measures. These scores were developed to describe the principals’ 
work on two special tasks that were administered during the test week. 
The first task was to prepare a probationary report and outline an inter- 
view with each of three teachers after visiting their respective classrooms 
(via a set of three kinescopes). The second task involved participation 
in five conferences at which special educational problems were under 
consideration (via tape recordings). The responses of the principals to 
both of these tasks were scored to reflect the degree of concern or aware- 
ness expressed in a number of defined areas. Table 102 presents the 
loadings of these two sets of measures on each of the eight estimated 
factors and on the second-order factors X’ and Y’. 

The two category scores Instruction and Pupils, for the job per- 
formance values, show moderate loadings on Factor A’ (L = .39 and 
.41). Fourteen of the remaining 15 scores have small positive loadings 
on this factor. The over-all pattern of these loadings suggests that Ex- 
changing Information and a sensitivity to the educational welfare of 
children go together. This is consistent with the general sensitivity and 
social responsiveness that were noted in the discussion of the relationship 
between Exchanging Information and the personality scores. 

The relationships between the 17 measures of Table 102 and Factor 
B’, Discussing before Acting, are small and inconsistent with respect to 
direction. 

The loadings on Factor C’, Complying with Suggestions, tend to be 
negative and moderate in size for the scores Planning (L = —.33), 
Objectives (L = —.32), Evaluation (L = —.24), and Curriculum 
(L = —.24). It will be recalled that in the factor analysis of the 12 
categories of instructional awareness a factor was identified as Concern 
for Program (see Chapter 9). This factor was defined by the high load- 
ings of these same four categories. The in-basket Factor C, therefore, 
appears to be negatively oriented with respect to concern for the educa- 
tional program. In other words, it appears that concern with an educa- 
tional program may act as a source of resistance to suggestions made by 
others. The evidence suggests that resistance to suggestion stems from 
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concern with the educational program rather than from professional 
knowledge (see Table 100). 

There are no interpretable loadings of the 17 performance measures 
on Factor D’, Analyzing the Situation. 

The loadings of these scores are generally positive for Factor EF, 
Maintaining Organizational Relationships, but tend to be smaller for the 
categories of instructional awareness than for the categories of job per- 
formance values. The problems presented in the later situation tend to 
involve superiors and outsiders in addition to teachers and pupils, which 
may account for their larger loadings on Factor E’. Maintaining Organi- 
zational Relationships may reflect instructional awareness or job per- 
formance values to the extent that these concerns have ramifications that 
involve relationships with superiors or outsiders. 

The categories of professional concerns show no particular relation- 
ship with Factor F’ except that signs are generally positive. The small 
positive loading (L = .25) of the score Interest on this factor is not 
readily interpretable. 

Each of the 17 measures in Table 102 loads positively on Factor 
G’, Responding to Outsiders. The larger loadings are for scores reflect- 
ing concerns for the educational program [Objective (L = .27), Evalu- 
ation (L= .29), Planning (L = .33), and Curriculump( i) see3a 90 
and concern for pupil reactions [Participation (L = .26) and Interest 
(L = .23)]. Concern with the reactions of pupils to teaching is also 
consistent with the interpretation of Responding to Outsiders as an ex- 
pression of a dedication to professional education. 

With the exception of the four measures that define concern with 
the educational program, the professional concern scores are all nega- 
tively loaded on Factor H’, Directing the Work of Others. The shift in 
sign at this point in the table and the tendency for the larger negative 
loading to be on scores which reflect concern with the human side of the 
problems [i.e., Pupils (L = —.30), Participation (L = —.24), Interest 
(L = —.24), Employees (L = —.20), and Personality (L = —.20)] 
suggests that Directing Others may be prompted by a narrow concern 
with achieving objectives that minimizes consideration of the reactions 
of others. 

The nature of the relationships between personal characteristics of 
the principals and the two second-order factors is further clarified by the 
loadings shown in Table 102. The relatively high loading on the cate- 
gory relating to educational objectives (L = .44) contributes to an 
understanding of the motivation for the emphasis on preparing for de- 
cisions. This evidence of a greater concern with objectives may be 
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coupled with the evidence suggesting that principals who refrain from 
taking final action possess superior professional knowledge. The com- 
bination of greater concern with objectives and superior professional 
knowledge provides an explanation of the hesitancy of certain principals 
to take final action, in view of the limitations of time and information 
which were inherent in the in-basket tests situations. 

Factors X’ and Y’ are differentiated to some degree by the pattern 
of loadings of the two sets of measures. Verbal facility, which character- 
izes Factor Y’, may be more important to the total task of comprehend- 
ing and responding to the tape-recorded problems than to the task of 
viewing a film and completing a moderately structured probationary 
report form. This difference may account for the larger loadings of most 
of the categories of job performance values on Factor Y’, Amount of 
Work. 


ESTIMATED FACTORS, INTERACTION CATEGORIES, AND 

BIOGRAPHICAL INFORMATION 

The fifth section of loadings to be presented includes two somewhat 
separate sets of measures. ‘The first is eight scores from the group inter- 
action situation, and the second is five items of biographical information. 
The loadings of the measures are presented in Table 103. 

Factor A’, Exchanging Information, appears to be somewhat more 
characteristic of women principals than of men (L = .45). The other 
loadings on this factor are too small to warrant interpretation. 

The nature of the unique part of Factor B’, Discussing before Acting, 
is made much clearer by the negative loadings of the group interaction 
categories on this factor. The consistent pattern of negative loadings on 
group interaction categories makes it clear that planning to discuss an 
in-basket problem with others is not associated with any special skill in 
face-to-face interaction. This observation, together with the small nega- 
tive loading to Total Years in Administration (L = —.18), suggests 
that the unique part of the in-basket factor Discussing with Others is 
simply recognition of a need for advice and counsel. 

The group interaction categories provide no useful information 
about Factor C’, Complying with Suggestions. The loadings of the bio- 
graphical variables indicate that Complying with Suggestions is much 
more a characteristic of men who are elementary school principals than 
of women (L = —.60). It is also characteristic of the younger, less- 
experienced principals (L = —.43). 

The group interaction categories have consistently positive loadings 
on Factor D’, Analyzing the Situation. Those that reflect most clearly an 
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active or even a dominant participation in the group interaction have the 
highest loadings on Factor D’ (Amount of Talking, L = .32; and Sug- 
gest New Procedures, L = .27). Such participation is consistent with 
the view of the personality of the principals who engaged in situational 
analysis which was discussed in an earlier section. Factor D’ also ap- 
pears to be more characteristic of men than of women principals 
(L = —.42) and perhaps to be positively related to amount of adminis- 
Sarverexperience (L.=—-.22). 

The group interaction categories have positive loadings on Factor 
E’, Maintaining Relationships, and the pattern of these loadings is sim- 
ilar to that for Factor D’. The major difference in loadings is for the 
score Suggests New Procedures, which has a higher positive relationship 
with Factor D’ than with Factor E’ (L = .27 as compared with .06). 
Analyzing the Situation thus appears to contain an element of readiness 
for change that is not evident in Maintaining Relationships. These two 
factors also differ in that Factor E’ is more characteristic of women 
(L = .22) and Factor D’ of men. 

Although all the group interaction categories have positive loadings 
on Factor F’, Organizing Work, only the score Gives Positive Informa- 
tion has a loading large enough (L = .33) to warrant interpretation. 
This definite preference for expressing positive information could be 
viewed as consistent with the prior information presented in the dis- 
cussion of the basic personality factors in Organizing Work. Perhaps 
the personal insecurity noted in the discussion of the relationship with 
personality factors could be involved in the preference for presenting 
positive information that is seen here. The biographical variables do not 
have interpretable loadings on Organizing Work. 

The general impression of weakness that has been developed regard- 
ing Factor G’, Responding to Outsiders, is further supported by the rela- 
tively large negative loadings of the group interaction categories on this 
factor. Principals who were responsive to outside pressure in their work 
on the in-basket problems tended to be ineffective in group interaction. 
The basic personality pattern of the responsive principal discussed earlier 
may also be responsible for the picture seen here of ineffective group 
participation. The biographical variables have loadings indicating that 
Responding to Outsiders tends to be more characteristic of the women 
principals (L = .50), the older principals (L = .40), and those who 
have the longer background of experience in education (L = .44). 
This longer experience is likely to be teaching experience rather than 
administrative experience. 

The group interaction categories show no interpretable loadings on 
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Factor H’, Directing Others. There are, however, small positive loadings 
of experience and age on this factor (L = .28). 

The interaction measures have small and generally positive loadings 
on both second-order factors, Preparation for Decision (X') and 
Amount of Work (Y’). The pattern of the loadings is similar on both 
factors with minor exceptions involving the categories Frequency of 
Interaction, Suggests New Procedures, and Attempts to Influence. The 
only interpretation that seems justified is that the superior mental abilities 
and greater professional knowledge found to be associated with these 
second-order factors in in-basket performance are also involved in ef- 
fective group interaction. The five biographical variables do not have 
important loadings on the second-order factors. 


ESTIMATED FACTORS AND PERFORMANCE EVALUATIONS 


The sixth and final section of the matrix of factor loadings to be 
discussed contains 17 evaluations of the performance. Fifteen of the 17 
are made by superiors and teachers on the basis of performance of the 
principals in their regular positions in their home schools. The remaining 
two are judgments made by project personnel. Table 104 presents the 
loadings of the 17 measures on the estimated factors. 

Each of the 17 ratings or other evaluations of the principal’s per- 
formance has a positive loading on Factor A’, Exchanging Information, 
and all except one of the superiors’ ratings (L = .16 for Rapport with 
Children) are substantial in size (L = .34 to .62). It appears that a 
principal who accepts exchanging information as an important part of 
his role in the administration of the school system will favorably impress 
his superiors. From the point of view of a superior, the principal is an 
important channel in the communication of the superior’s influence and 
control over the operation of the school system; a superior must rely on 
this principal to carry out his wishes and to provide much of the informa- 
tion that he needs to function effectively. Such a view of the relationship 
between the principal and his superiors is consistent with the high load- 
ings of the superiors’ ratings on Factor A’. 

The general direction of the loadings of the evaluative measures on 
the unique part of Factor B’, Discussing before Acting, is negative. To 
involve others frequently in discussions of administrative problems ap- 
pears to be regarded as a sign of weakness by both the principal’s su- 
periors and his teachers. Superiors apparently regard such discussion as 
indicative of a lack of knowledge of administration (L — —.40) and 
teachers as a lack of initiative (L — —.30 for Initiation of Structure). 

The loadings of the 17 measures on Factor C’ are similar to those on 
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Factor B’ in that they are generally negative, but they are generally 
somewhat larger for Complying with Suggestions. Superiors regard 
Complying with Suggestions as indicative of (1) a lack of knowledge of 
teaching and administration (L = —.43 and —.33), (2) a lack of 
interest in the job and of ability to stick to it (L = —.39 and —.36), and 
(3) perhaps a reflection of inability to get along with others. Teacher 
reactions are again negative and indicate that inability to initiate structure 
is associated with Factor C’ (L = —.30). 

The loadings on Factor D’, Analyzing the Situation, are generally 
negative but small. Superiors note a lack of knowledge of teaching 
(L = —.22) and some failure to get along with superiors (L = —.26) 
or to develop rapport with children (L = —.22) for principals who 
analyze the situation. Teacher ratings of consideration load negatively 
on this factor (L = —.21). These relationships are consistent with the 
loadings noted in the personality area, especially those indicating that 
aloofness, dominance, and a tough, practical orientation were associated 
with Analyzing the Situation. Another possible interpretation is that 
ability to analyze the situation is either not perceived or not valued by 
superiors and teachers. 

The superiors’ ratings do not show interpretable loadings on Factor 
E’, Maintaining Relationships. However, the highest of the small load- 
ings is for the rating item Getting Along with Teachers (L = .13), which 
is in agreement with the teachers’ reports. The Teachers’ Reaction score 
and their descriptions of the consideration which characterizes their 
principal’s behavior have substantial positive loadings on Factor E’ 
(L = .42 and .49). 

The loadings of the superiors’ ratings on Factor F’, Organizing 
Work, are again consistently negative. It is doubtful that the actual be- 
havior of organizing work would be disapproved by superiors; it is more 
likely that the pattern of personality characteristics which was shown to 
be associated with this factor in the principal’s work was regarded un- 
favorably. That the superiors’ negative impression may be created at the 
more personal level is suggested by the fact that the highest of the nega- 
tive loadings is for the rating item Over-all Impression (L = —.35) 
followed by the item Getting Along with Superiors (L = —.31). 

The two loadings on Factor G’, Responding to Outsiders, that are 
large enough to be interpreted give additional support to the view of the 
basic nature of this factor that has been developed. The two loadings 
are both negative. One is a rating made by superiors on the item Oral 
Communication (Informal) (L = —.27) and the other by the staff 
member (Over-all Impression) at the conclusion of the test week 
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(L = —.34). The desurgent personality characteristics which were 
found to be associated with this factor might account for both tendencies 
in the ratings. 

The teachers’ general reaction and their description of their princi- 
pal’s consideration are both negatively loaded on Factor H’, Directing 
Others (L = —.26 and —.21). This is consistent with earlier observa- 
tion of an element of disregard for human relations in this factor. 

Evaluations made by superiors, staff members, and the in-basket 
scorers all are in agreement in having definite positive loadings on the 
second-order Factor X’, Preparation for Decision, and also tend to be 
consistently positive on Factor Y’, Amount of Work. The in-basket 
scorers’ over-all impression of the principals loads high on both second- 
order factors, particularly on Factor Y’ (L = .55). Principals who re- 
frain from hasty decisions and who produce a good volume of work 
apparently make the better impression on those who judge their per- 
formance. 


COMPOSITE SCORES VS. UNIQUE COMPONENTS OF 
FACTORS 


The relationships of the unique components of the in-basket per- 
formance factors to other variables (summarized in Figure 5) differ 
markedly from the relationships of composite factor scores to the same 
variables (as these were reported in Chapter 12). A specific and strik- 
ing example of these differences is provided by Factor B, Discussing Be- 
fore Acting. Table 105 shows a comparison of relationships as deter- 
mined (1) by correlating the composite score for Factor B with 25 
selected variables (Chapter 12) and (2) by the analysis reported in 
this chapter. 

It is evident from the comparison of Columns 2 and 3 of Table 105 
that the composite scores for this factor and its unique component should 
not be confused. The Factor B composite score is related to knowledge 
of administration, basic mental abilities, oral communication skill, and 
concern with instructional problems. The unique component of Factor 
B, in contrast, is not related to these variables but, instead, is related 
to a lack of knowledge of administration as rated by superiors, lack of 
administrative experience, ineffectiveness in group interaction, and free- 
dom from insecurity and nervous tensions. Thus it is clear that the com- 
posite score for a factor and its unique component are not the same, 
even though the composite contains the unique component of the factor. 

The composite scores are mixtures (see pages 256-257), some part of 


TABLE 105. Relationships of 24 selected variables to composite scores for 
factor B, unique component of factor B, and second-order 


factor X 
Variables Composite 
B 
Basic Mental A bilities 
Verbal Knowledge 29 
Associational Fluency 33 
Number Facility 2 30 
Inductive Reasoning v3 
Speed of Closure 25 
Visualization io 


Professional and General Knowledge 
School Administration and 


Supervision 7 
NTE Science and Mathematics .26 
Basic Personality Factors 
C. Emotional Stability ne 
O. Insecurity —.02 
Q,. Nervous Tension .0O 
Categories of Instructional Awareness 
Personality P32 
Methods 31 
Interests FOU 
Objectives 29 
Categories of Job Performance Values 
Physical —.06 | 
Structure Eb) 


Group Interaction Categories 


Gives Positive Information .07 

Presents Facts Effectively 18 

Amount of Talking ibe) 
Biographical Information 

Age .03 

Administrative Experience —.03 


Superiors’ Ratings 
Knowledge of Administration .20 
Oral Communication Skill (Informal)  .38 


Teacher Questionnaire Score 
Teachers’ Reaction 10 


Unique Factor 
B xX 
—.14 33 
—.03 oo 
—.10 .40 

O01 34 
pede 15 
19 28 
—.09 41 
.09 28 
[26 12 
—.28 —.11 
—.30 —.10 
.06 125 
.02 23 
—.03 19 
—.97 si 
—.20 18 
02 24 
—.31 14 
—.31 ‘29 
—.29 21 
—.15 .00 
—.26 07 
—.40 18 
—.17 18 
—.16 .09 
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which is the unique component of the factor; but the unique component 
may be masked by other components of the mixture. How this masking 
occurs can be seen by considering Column 3 of Table 105. This column 
shows the relationship between another component of the composite 
score for Factor B—the second-order Factor X, Preparation for Deci- 
sion vs Taking Terminal Action. Data presented in Table 91 suggest 
that Factor X is even a more prominent part of the composite score for 
Factor B than is its unique component. A very crude approximation of 
the effects of mixing the unique component of Factor B and the second- 
order Factor X can be obtained by averaging the two coefficients for 
each variable. Thus, for example, the coefficients for the variable Verbal 
Knowledge (—.14 and .33) average to a value of .10, which is 
nearer the correlation with the composite score than is the coefficient 
for the unique component alone (—.14). Composite scores for Factor 
B, of course, are not a simple mixture of just these two components (see 
pages 271-274); they include other effects in addition. However, it is of 
interest to note that 23 of the 25 variables in Table 105 yield results 
similar to that noted above for Verbal Knowledge. 

In comparing the finding reported in Chapter 12 with those reported 
here, one must keep clearly in mind that the two basically different 
analyses have been employed. The relationships reported in Chapter 12 
are those most likely to be observed in the unrefined and phenotypical 
experiences of everyday life. Those relationships described in this chapter 
are not likely to correspond with everyday impressions of the layman, 
but will likely be of much more use to the serious student of behavior 
in achieving an understanding of the complicated and interrelated facets 
of his subject. 


SUMMARY OF ANALYSIS 

Figure 5 summarizes the major relationships between the perform- 
ance of the principal on the in-basket tests and the other variables. 

Although the information presented in the chart is highly simplified, 
it provides a quick over-all summary of the major relationships between 
performance on the in-basket test problems and the other variables of 
the study. Further interpretation and consideration of the implications 
of these relationships will be the theme of Chapter 14 which will draw 
heavily on the facts and data reported in this chapter. It will depart from 
the factual reporting that has characterized the preceding chapters and 
present a general and speculative interpretation of some implications of 
the study for the solution of many practical problems which face the ed- 
ucational administrator. 


FIGURE 5. Summary of relationships with unique components of in-basket performan 
interaction performance, biographical data, and evaluations 


Performance Personality, 
on In-basket Abilities and Interest, and Professional 
Problems Knowledge Values Concerns 
Factor A Has high verbal Sociable, sensitive, Concerned with teacher a) 
Exchanging knowledge and facility; trusting, confident, and pupil personnel problems, 
Information knows elementary relaxed; interests like especially with the reactio 
education, school superintendents, lawyers, of pupils to the education 
administratration, and facts or psychologists, unlike program 
about the general culture policemen : 
Factor B Not related Mature, self-confident, Not related 


Discussing Before 
Acting 


and relaxed; interests 
like policemen and public 


administrators 
Facror C Ability to reason and sees Aloof, shy, practical, Not concerned with 
Complying with relationships; knows skeptical, independent, objectives, evaluation, 
Suggestions general cultural facts, insecure, unstable and planning and continuity, 
science, and mathematics; tense; interests like curriculum, or child 
learns new material policemen, unlike school growth and development 
rapidly superintendents 
Facror D Ability to reason and see Aloof, dominant, Not concerned with 
Analyzing the relationships; knows practical, shrewd; feels classroom climate or 
Situation general cultural facts, pressure; interests like routines 
science, and mathematics policemen and public 
administrators 
Factor E Slow in seeing Sociable, lively, sensitive, Concerned with instructio 
Maintaining relationships; lacks confident, dependent, and curriculum, personnel, an 
Relationships knowledge of science and relaxed; interests like public relations 
mathematics superintendents and 
lawyers 
Facror F Not related Easily frustrated, Concerned with pupil 


Organizing Work 


inflexible, shy, skeptical, 
insecure, unstable, and 
tense; interests unlike 


reactions and physical 
setting of classroom 


superintendents, 
administrators, and 
psychologists 
FACTOR G Lacks general ability; Submissive, subdued, shy, Concerned with objectives 
Responding to lacks knowledge of : naive, stable, and relaxed; planning, evaluation, and 
Outsiders science and mathematics, interests unlike public effects of teacher 
school administration, administrators and lawyers performance 
and general culture 
Factor H Lacks knowledge and Sober and stable; interests Concerned with objectives 


Directing Others 


ability; unable to learn 
hew material quickly 


unlike school 
superintendents and 
lawyers 


but not personnel or pup: 
reactions 


Facror X Fluent, facile with Values educational needs Concerned with most arez 
Preparation for symbolic material, sees of pupils; interests similar of teacher performance, 
Decision associations quickly, good to psychologists and especially objectives, 

at reasoning; knows lawyers planning, methods, 
school administration, teacher personality, pupil 
elementary education, motivation, and child 
science, and facts about growth 
general culture; learns 
new material rapidly 

Factor Y Over-all high ability; Not related Concerned with curriculu 


Amount of Work 


fluent with words and 
ideas; knows elementary 
education, school 
administration, cultural 
and scientific material; 
learns new material 
rapidly 


child growth, teacher ) 
personality, and personne 
problems 
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vith abilities and knowledge, personality, interest, and values, professional concerns, 


Interaction ; : 

Performance Biographical Data Evaluations 
Not related More characteristic of women Superiors—very positive 
‘Teachers—positive 

Scorers—positive 
Reluctant to participate, regarded Little administrative experience Superiors—negative 
is ineffective Teachers—negative 
Not related Young, little experience; more Superiors—very negative 
characteristic of men Teachers—negative 

Participates fully and moderately Has administrative experience; Superiors—negative 
effectively; talks a lot and suggests more characteristic of men Teachers—negative 
new procedures 
Participates fully and effectively More characteristic of women Teachers—very positive 
Emphasizes positive information in Not related Superiors—generally negative 
interaction; not effective Teachers—positive regarding 


initiating structure 


Does not participate, regarded as Has large amount of teaching Superiors—neutral to slightly 

ineffective experience; older; more negative ; 
characteristic of women Staff members—negative 

Not related Has experience in education; Teachers—negative 

. older 

Active and effective in group Not related Superiors—positive _ 

discussion; suggests new procedures Staff members—positive 


Scorers—strongly positive 


‘Effective in interaction, talks a Not related Superiors—neutral to slightly 


lot, tries to influence positive ye 
Staff members—positive 
Scorers—strongly positive 
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Chapter 14 


IMPLICATIONS FOR THE 
PRACTICE OF ADMINISTRATION 


IN THE PRECEDING CHAPTERS THE ANALYSIS AND INTERPRETATION OF 
data have been reported with the conservatism which is traditional for a 
research report. Few liberties were taken in considering what the find- 
ings could imply. The discussion in this chapter may at times go beyond 
a completely rigorous interpretation of the research findings, and the 
authors may at times reveal their biases and values. The suggested im- 
plications, however, will never be simply “‘armchair” speculations; they 
will be held within reasonable bounds by constantly relating them to 
specific findings reported in earlier chapters. 


THE STUDY—A RECAPITULATION 
The three stated objectives of the study were: 


1. To determine dimensions of performance in the elementary 
school principalship and thus develop a better understanding of the 
nature of the job of the school administrator. 

2. To provide information helpful in the solution of the problems 
of selecting school administrators. 

3. To provide materials and instruments for the study and teaching 
of school administration. 


The study was divided into six steps, beginning with a survey of job 
descriptions and conceptual analyses of the elementary school principal- 
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ship. This work resulted in the construction of a 12-category classifica- 
tion schema that was useful in guiding the development of materials for 
the study. 

The second step entailed the development of materials used to 
simulate an elementary school and thus to create a standard administra- 
tive situation. Background materials were developed with which subjects 
could be taught the important features of the school in a day and a half. 
Special in-basket tests, kinescopes, and tape recordings were constructed 
to present administrative problems in the simulated school situation. 
Several published tests of abilities, knowledge, interests, and personality 
were selected to be administered to the principals who were the subjects 
of the study. Other instruments were constructed to obtain information 
regarding the experience, training, and performance of the subjects in 
their home school situations. 

Third, the materials were then given a preliminary tryout with 55 
principals. Only minor revisions were found necessary. 

Fourth, centers were set up in various parts of the country for testing 
an additional 177 principals. The testing was completed during the fol- 
lowing year. 

The fifth step of the study was concerned with the scoring and anal- 
ysis of the products of the work of the school principals. Forty in-basket 
scoring categories were included in a factor analysis, which resulted in 
eight first-order factors and two second-order factors. Similar proce- 
dures were used in the analysis of data from other parts of the study. 
Composite scores based on the eight first-order factors were correlated 
with all the other measures obtained on the subjects. 

Finally, a special use of a factor analytic method permitted a de- 
tailed examination of relationships among all the major variables of the 
study and unique components of administrative performance. 


IMPLICATIONS FOR THE SELECTION AND PREPARATION 
OF ADMINISTRATORS AND FOR THE PRACTICE OF 
ADMINISTRATION 


Since administration, like medicine, is a highly practical art, research 
on administration may, in part, be judged in terms of its usefulness in 
solving the problems and dilemmas of practicing administrators. This 
study has implications for the solution of many practical problems of ad- 
ministration some of which are discussed below. 
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SELECTION 

There are many questions concerning the selection of administrators 
for which there are at present no known satisfactory answers.’ One of 
the most pressing needs is to find a dependable method of selecting peo- 
ple for their first principalship. This is probably the aspect of the prob- 
lem for which a solution is most desired by superintendents and school 
boards. Selection procedures are also needed for determining the best 
qualified among those who have been school principals and who have 
had different amounts and kinds of experience; most school districts 
either employ experienced principals from other districts or promote 
from smaller to larger schools within their own system. Further, selec- 
tion procedures are needed by graduate schools of education to screen 
people for admission to programs preparing for careers in school admin- 
istration. 

Let us consider some of the problems of selecting people for their 
initial principalship. Among the questions of immediate interest are 
these: 


1. Should men be selected for the principalship in preference to 
women? 

2. How important is experience in education for success in the 
principalship? 

3. Is personality, as measured by inventories, likely to be predictive 
of administrative performance? 

4. Are mental abilities, as measured by tests, related to administra- 
tive performance? 

5. Are interests, as measured by inventories, indicative of adminis- 
trative performance? 

6. Can a battery of relatively short, economical paper-and-pencil 
tests be recommended for use in selecting principals? 


Men-—Women. One of the perennial questions asked in selecting 
principals is “Should men be appointed as elementary school princi- 
pals in preference to women?” Boards of education display a distinct 
preference for men, not only for high schools but also at the elementary 
level. This is clearly demonstrated by the fact that while men constitute 
only seven per cent of the elementary school teaching force, they ac- 


* For the most recent review of selection research see American Association 
of School Administrators, Professional Administrators for America’s Schools, 
Thirty-Eighth Yearbook (Washington, D.C.: The Department, 1960), Chapter VI. 
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count for 59 per cent of the principalships.? Is this preference justified 
by superior performance of men principals? This study has made it 
possible to compare the administrative performance of 137 men and 95 
women principals who handled the same problems in the same school 
situation. What can now be said in answer to this perennial question? 

The aspects of administrative performance most characteristic of 
women, as reflected in the unique components of the factors, are those of 
Factor A’, Exchanging Information, Factor E’, Maintaining Organiza- 
tional Relationships, and Factor G’, Responding to Outsiders. On the 
other hand, the administrative performance of men principals is charac- 
terized by Factor C’, Complying with Suggestions Made by Others, and 
Factor D’, Analyzing the Situation. When performance was evaluated 
by superiors and by teachers, it was found that both groups were some- 
what negative toward men principals and generally positive toward the 
women principals. 

The administrative performance of each can be further described 
by referring to the scoring categories which make up these factors (see 
Table 87). These specific categories clarify the difference between men 
and women as principals and help to explain why women are preferred 
by superiors and teachers. The work of women principals was charac- 
terized to a greater degree than that of men by asking subordinates for 
information. Women tended to do more work on in-basket items, dis- 
cussed problems more with superiors or outsiders, and used information 
found in the background materials somewhat more frequently than men. 
The characteristics on which the performance of men principals ex- 
ceeded that of women was in marked contrast. Men made more conclud- 
ing decisions, followed pre-established structures more often, and took a 
greater number of terminal actions. In general, the difference between 
men and women in their performance on in-basket problems is that the 
women involved teachers, superiors, and outsiders in their work, while 
the men tended to make final decisions and take action without involving 
others. 

This contrast in the behavior of men and women is very similar to 
that found in the Florida Leadership Project.* Behavior similar to that 
described above for men was called “undemocratic.” It was found that 


* Department of Elementary School Principals, The Elementary School 
Principalship, Thirty-Seventh Yearbook (Washington, D.C.: The Department, 
1958), p. 227. 

> Hulda Grobman and Vynce A. Hines, “What Makes a Good Principal?” in 
The Bulletin of the National Association of Secondary-School Principals, Vol. 40, 
No. 223, Nov. 1956, pp. 5-16. 
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“democratic” behavior was more characteristic of women; furthermore, 
teachers expressed greater satisfaction with the human relations which 
existed in schools administered by democratic than by undemocratic 
principals.* 

Since a modern concept of the job of an elementary school principal 
includes the providing of instructional leadership in the school, differ- 
ences between men and women in the ability to perform this function 
are of interest. Superiors’ ratings on “knowledge of teaching methods 
and techniques” tended to be higher for women. In dealing with the in- 
structional situations presented on kinescopes, women tended to be more 
concerned with the objectives of teaching, pupil participation, and the 
evaluation of learning. It would appear that in the eyes of superiors and 
in terms of how they handle the problem of evaluating the performance 
of probationary teachers, the women are more able or willing to provide 
instructional leadership than are men. 

When scores on tests of mental ability were compared, no extreme 
differences were found. Differences favored women slightly in the areas 
of verbal fluency and number facility, while men earned higher scores 
on tests of reasoning and visualization. 

In considering the question, “Should men be appointed as elementary 
school principals in Sear to women?” it would appear that the 
answer is probably no. 

This study does not present evidence that a woman principal should 
always be preferred over the man who may also be a candidate. It does 
indicate, however, that as a class men are not overwhelmingly superior 
to women as elementary school principals. The evidence appears to 
favor women if the job of the principal is conceived in a way that values 
working with teachers and outsiders; being concerned with objectives of 
teaching, pupil participation, and the evaluation of learning; having 
knowledge of teaching methods and techniques; and gaining positive 
reactions from teachers and superiors. But the relationship is not so 
strong that choosing a woman will automatically produce these char- 
acteristics; there is a great deal of overlapping of the distributions of 
scores on such attributes. 

Experience. Practically all the state certification requirements for 
the elementary school principalship include teaching experience. Is 
experience as a teacher related to administrative performance? 

In this study no distinctions were made between teaching experi- 
ence and other professional experience in education, except for the 


“Ibid., p. 10. 
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category “administrative experience.” Comparisons cannot be made of 
various combinations of teaching and administrative experience, but 
some facts relevant to the question are available. 

There are substantial loadings of experience on the unique com- 
ponents of three of the administrative performance factors. The highest 
of these is the negative loading on Factor C’, Complying with Suggestions 
Made by Others. Principals who score high on Factor C’, when con- 
fronted by a problem accompanied by a suggestion as to how it might 
be handled, tend to follow the suggestion. Other evidence suggests that 
decisions are not made by reliance on knowledge of school administra- 
tion and supervision, of elementary school education, or of the objec- 
tives of education. It would appear, on the contrary, that principals who 
lack experience in education are forced to choose among suggestions 
made to them on the basis of their general ability to reason. They fol- 
low suggestions which would appeal to the layman as reasonable, even 
though professional knowledge might have suggested a different course 
of action. 

On the other hand, those principals with the most experience in 
education tend to display the administrative performance described by 
Factors G’ and H’. The unique component of Factor G’, Responding to 
Outsiders, is a pattern of performance by which the principal gives in- 
formation to outsiders, follows suggestions or leads by outsiders, and 
shows courtesy to outsiders. Factor G’ principals show concern for all 
phases of teaching, but they earn negative evaluations from superiors, 
appear to lack ability and knowledge, and are relatively ineffective in 
the interaction problem. Those principals characterized by the unique 
component of Factor H’, Directing the Work of Others, earn negative 
ratings from teachers, are concerned with objectives of instruction but 
not with teachers or pupils, and lack general knowledge and ability. 

The evidence on the value of experience is not as clear-cut as the 
professional educator might like. There is no information in this study 
about the administrative performance of principals with no teaching 
experience. Those principals who have little administrative experience 
tend to follow suggestions made by others and to discuss with others 
before taking final action. Those with more administrative experience 
respond to outsiders, direct the work of others, and analyze the situation. 
It would seem that the performance of those with more, rather than 
less, experience would result in somewhat better instructional programs. 
Concern for or sensitivity to instructional problems appears unrelated to 
amount of administrative experience. Since a prime purpose of the 
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schools is to give instruction, it would seem that performance in this 
area should show significant differences, but the study failed to provide 
evidence that could be interpreted in this direction. 

Personality. The possibility of using personality measures in the 
selection of administrators has intrigued students of administration for 
years. However, the efforts of researchers have not yielded generally 
useful results. The American Association of School Administrators’ 
1960 Yearbook Commission summarized efforts to date in this way:® 


Another set of traits which undeniably bear some relationship to leadership 
is most often lumped under the portmanteau term “personality.” There are 
several objective-type, paper-and-pencil inventories which purport to meas- 
ure traits, and these instruments are all available, even though they require 
an analyst for interpretation. As yet, no convincing case can be made for 
their use in selection, other than in screening out extreme deviants. 


A similar attitude toward personality tests has been expressed by 
writers in the field of business administration. For example, Meyer and 
Bertoti say:® 


. . . personality tests have generally proved less valid than tests of abilities 
or aptitudes. 

Even if we could measure personality traits accurately, there is certainly 
room for doubt that we know what the ideal “personality” is for an account- 
ant, a salesman, a lawyer, a manager, or even a president. Research studies 
have shown that often men with entirely different personalities have been 
successful in the same positions. 


The difficulties in studies of personality tests for use in administrator 
selection are of three varieties: 


1. The lack of a suitable criterion of success against which the tests 
can be examined for validity. 

2. Special technical problems in the construction of tests of per- 
sonality. 

3. The use of simple correlational analyses in investigating possible 
relationship between test scores and criterion information. 


When the personality data in this study were treated in accordance 
with the usual correlational procedures, the same results were obtained 
as are universally reported. For example, when personality test scores 
were simply correlated with superiors’ and teachers’ ratings, the highest 
correlation obtained was .18 (Table 83). This correlation coefficient is 


5 Professional Administrators for America’s Schools, p. 156. 
°M. J. Dooher and Elizabeth Martiniz (Eds.), Selection of Management 
Personnel (New York: American Management Association, 1957), p. 437. 
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significant at the one per cent level, but is too low to be of much value 
in selection. A far different result was obtained, however, when the 
unique components of the eight factors were used as criterion measures. 
When this was done, very interesting patterns of relationships with per- 
sonality test scores were obtained for each of the eight factors. 

It will be recalled that the coefficients expressing these relation- 
ships are not correlation coefficients but are proportional to correla- 
tions. Since we do not know the actual magnitude of the relationships, 
it is impossible to estimate precisely how much the use of personality 
measures can add to the prediction of success. Nevertheless, the use of 
personality inventories in the manner suggested below seems justified. 

Candidates for the position of elementary school principal might 
first be screened for mental ability and professional knowledge. Per- 
sonality measures can best make a contribution if used in conjunction 
with mental ability and professional knowledge tests. It is suggested 
that personality tests be employed at the second stage of a selection 
procedure. The first step would be to screen the candidates to ascer- 
tain that they had the high general and professional ability needed to 
perform effectively in the different areas of the job. Personality tests 
could then be employed to make selections among those candidates who 
have met the first screening requirement. The two-step procedure is 
suggested because ability and knowledge tests appear to have a more 
general relationship to the administrative performance dimensions and 
because these tests are likely to appear more acceptable to candidates. 

As an example, let us assume that a school district wants to employ 
principals who are proficient at maintaining organizational relationships 
(Factor E’). The personality requirements, as measured by the 16 PF 
(Table 101), for such a principal are that he be: 


. Friendly, socially responsive 

. Lively and enthusiastic 

. Bold, warmhearted, and spontaneous 
. Self-confident and accepting 

. Free from worry and anxiety 


MP WN 


The coefficients for these characteristics on Factor E’ range from 
.29 to .51 and appear to warrant consideration in selection. It can be 
seen that the characteristics tend to “go together” and form a picture of 
a personality type. Further, it appears to be entirely reasonable that a 
friendly, enthusiastic, spontaneous, self-confident, worry-free principal 
will be strong in maintaining organizational relationships. Candidates 
who had previously passed the tests of general ability and professional 
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knowledge could be further screened by use of available inventories to 
obtain the desired personality characteristics. 

Suppose a school district desired a principal whose forte was re- 
sponding to outsiders, i.e., a principal who would listen to and serve 
the patrons of the district. What would be the personality attributes of 
this kind of principal? It appears (Table 101) that they would include: 


. Submissiveness, modesty, and obedience 
Simple sentimental naiveté 

Lack of enthusiasm 

. Shyness and timidity 

. Persistence and stability 

. Lack of anxiety 


The coefficients of these personality characteristics on Factor G’ 
range from .22 to .37 and also tend to constitute a personality type. But 
on the other hand, suppose the school district wanted a principal who 
would stand firmly between his teachers and the pressures of an overly 
active and critical group of patrons. Personality tests could then be 
applied in reverse direction to that indicated above. 

These illustrations show the impossibility of stating a general for- 
mula for the application of personality information; what scores would 
be considered desirable is a function of the particular situation in the 
school district. 

Personality might make a valuable addition to a battery of tests for 
selecting principals, providing the school district is able to describe the 
principal it wants in terms of factors of administrative performance. 

Mental Abilities and Knowledge. ‘There are several marked rela- 
tionships of tests of mental abilities and knowledge to six of the primary 
and both of the secondary factors. The relationships could be useful in 
the selection of principals. 

Let us suppose that a school district wants a principal whose ad- 
ministrative performance can be characterized as being near the “prepa- 
ration” end of the bipolar Factor X’, Preparation for Decision vs. Taking 
Final Action. What tests could help to select a principal who would per- 
form in such a way? Any one or all of the following tests (Table 100) 
could be used: 


1. School Administration and Supervision 

2. Education in the Elementary School 

3. NTE General Culture Test: Social Studies, Literature, and Fine Arts 
4. A battery of tests of basic psychological abilities 


The principals who score high on these tests tend to exhibit adminis- 
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trative performance which is near the “preparation” end of the Prepara- 
tion for Decision vs. Taking Final Action factor. In other words, princi- 
pals of high general mental ability are characterized more by preparation 
for decision than by taking terminal action. 

High work output is another characteristic which might be desired 
by a school district. This factor (Factor Y’, Work Output) is typical of 
high mental ability principals. The same tests as are predictive of 
Preparation for Decision would likely predict high work output. 

Interest Inventories. Although all the Strong Vocational Interest 
Blank for Men scoring keys were scored, only five were examined in 
detail for relationships with the administrative performance factors: city 
school superintendent, policeman, psychologist, public administrator, 
and lawyer. While none of the keys are significantly related to Factor Y’, 
Work Output, two or more keys are related to each of the other factors. 
Here again, if a district determines the factors it wants in a principal, 
Strong Vocational Interest Blank for Men scores might be of some help 
in making a choice. 

As an example, interest scores could help to pick a principal high on 
Factor A’, Exchanging Information. Persons high on Factor A’ have 
interests unlike those keyed for policeman, but positively related to the 
interests of city school superintendent, lawyer, and psychologist. 

A conclusion reached in this study about the problem of selection is 
similar to that of other studies of the selection of administrators. No one 
test can be recommended that will unerringly choose a “successful” 
principal. Selection remains what it has always been, a highly complex 
act. In fact, this study suggests that the selection of principals is even 
more complex than it has previously been considered. Most of the previ- 
ous studies have considered that there were such persons as “successful” 
administrators and have attempted to find instruments that could identify 
them. This study has pointed up the fact that different reference groups 
—the principals’ teachers, their superiors, and lay in-basket test scorers 
—do not agree as to the “good” or successful principal. Reliance on the 
judgments of a single reference group as criteria could lead one far 
astray. The study also shows the multidimensionality of administrative 
performance and suggests that evaluations involving only one dimension 
may be misleading. If a school district can describe the principal it de- 
sires in terms of the factors which have been identified, then some of the 
tests used in this study should be considered for use in selecting the de- 
sired principals. 

It might be suggested here (1) that women should not be discrim- 
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inated against as candidates for principalships, and (2) that personality 
and interest tests might profitably be employed after all candidates have 
been screened for mental ability and professional and general knowledge. 

Although the discussion of selection problems has been in terms of 
selecting a principal for a position within a school district, many of the 
same considerations would apply to the problem of selecting students 
for graduate training in school administration. 


THE PREPARATION OF SCHOOL ADMINISTRATORS 


A most intriguing set of implications of this study is concerned with 
the preparation of school administrators. College and university pro- 
grams have come in for considerable criticism of late, as witness the 
statement of the 1960 Yearbook Commission of the American Associa- 
tion of School Administrators.* 


The programs [of preparation] appear to be bookish to the ultimate. 

The mediocrity of the programs of preparation comes from the sterility of 
the methods reported. Instruction is classroom bound; administration is 
talked about rather than observed, felt, and in these and other ways actually 
experienced. Where the student should be “scared” by exposure to the facts 
of administrative life, he is instead bored by the tame fare of second-hand 
success stories. . . . Generally speaking, schools of education and depart- 
ments of school administration have not found ways of bringing their students 
into contact with professors from other disciplines; they have not made use 
of the public schools as laboratories; and they have not revised preparation 
programs to include cases, role-playing, field study, simulations, or any 
other of a multitude of techniques. 


All of these woes cannot be cured by one study, yet there are some 
leads and suggestions in this study. Implications as to the structure, con- 
tent and methods of teaching, and student selection are discussed below. 

Structure of Programs of Preparation. One of the sets of correla- 
tions shown in Table 80 should give all professors of school administra- 
tion cause for concern. It indicates that the correlation of years of 
preparation with superiors’, teachers’, and scorers’ ratings is zero. There 
is a small correlation between the research staff’s ratings and years of 
preparation (.17, which is statistically significant), but it is hardly of 
practical value. This small correlation may be accounted for by the fact 
that those principals holding doctor’s degrees were usually known to the 
staff members, and this may have influenced some of the ratings. The 
finding of essentially no relationship between amount of academic prep- 
aration and performance on the various tasks in school administration 


" Professional Administrators for America’s Schools, pp. 83, 84. 
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that were investigated is consistent throughout. There is no evidence 
suggesting that the principal with a lengthier preparation does a more 
effective job of school administration, from any point of view from which 
one may examine the data. 

There are several possible explanations for the zero correlations 
between years of preparation and the factors of administrative perform- 
ance and reference group ratings. One explanation might be that there 
is nothing taught in programs of preparation that is relevant to being a 
principal. This is apparently an unsatisfactory explanation, since tests of 
professional knowledge do correlate significantly and positively with the 
composite scores of all primary factors except Factor C and also are 
related to the unique components of many of the factors (Table 89 and 
Chapter 13). The correlation of years of preparation with the School 
Administration and Supervision test is .17 and with Education in the 
Elementary School is .07. The possession of professional knowledge is 
reflected in the performance of the principals, yet is not accounted for by 
substantial correlations with years of preparation. 

A more reasonable explanation may be found in an examination of 
the composition of the variable “years of preparation.” The variable was 
obtained by adding together all the post-high school years of formal ed- 
ucation. If, for example, the principal was a college graduate with two 
years of graduate work he would be categorized as having six years of 
preparation. The amount of professional education included in “years 
of preparation” is obscured in such figures, since the principals could 
have had an almost infinite number of combinations of liberal arts, gen- 
eral education, and professional education courses. It is entirely possi- 
ble, for instance, for some who were graduates of liberal arts colleges 
not to have had any professional education in their undergraduate years, 
while it is equally possible for others to have had 30 or 40 semester 
hours of course work in education in their undergraduate college. 

Content and Methodology. In recent years there has been a change 
in thinking about the preparation of school administrators. This has 
been demonstrated in shifts in curricular offerings at certain universities. 
As Moore puts it:8 


The changes which seem to be most promising are those which recognize 
administration as a job primarily of action and that while action must be 
based on essential knowledges, more of our training in the future must center 
on successful behavior on the part of administrators. Training people to 
deal with situations, not just know about them is the crux of the matter. 


* Hollis Moore, Studies in School Administration (Washington, D.C.: Ameri- 
can Association of School Administrators, 1957), p. 66. 
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The AASA Yearbook quoted above indicates that the changes suggested 
by Moore had not been adopted by substantial numbers of universities. 

The successful introduction of course work relating to administrative 
performance has been retarded because of a lack of theory and taxonomy 
of performance and because of inadequate methods of teaching. It 
should be said that one area of preparation, namely school finance, does 
have a sound theoretical basis, and many effective techniques have been 
developed for its teaching. It is probably because of this that school 
superintendents rank it first among the courses they have taken. This 
study suggests a framework around which a part of an action-oriented 
program for the preparation of school principals could be built. 

A set of categories comprising a taxonomy of administrative per- 
formance is the set of primary factors developed in this study. These 
are listed once again: 


Factor A’ Exchanging Information 

Factor B’ Discussing with Others Before Acting 

Factor C’ Complying with Suggestions Made by Others 
Factor D’ Analyzing the Situation 

Factor E’ Maintaining Organizational Relationships 
Factor F’ Organizing Work 

Factor G' Responding to Outsiders 

Factor H’ Directing the Work of Others 


Before proceeding to discuss the use of this taxonomy in developing 
a curriculum for preparing school principals, it should be made clear 
that we are not suggesting a new set of courses, one for each factor. 
There is no proposal that there be a course Ed. 401, Maintaining Or- | 
ganizational Relationships, or even a super seminar Ed. 503, Exchanging 
Information. What is suggested is that the factors, the components of 
administrative performance in the elementary school principalship, be 
used to suggest experiences which should be provided throughout the 
total program of preparation. 

An obvious example of the use of the components is the factor Or- 
ganizing Work. This is an aspect of performance on which the principals 
varied widely. While the factor is most clearly defined by the specific 
acts of scheduling work, it also includes other aspects of an organized 
and orderly approach to the handling of administrative problems. There 
would seem to be little disagreement about the desirability of acquiring 
the skills called for by high scores on Organizing Work in administrative 
training. 

How could Organizing Work be included in the graduate training 
program? If only the traditional methods of instruction were used sev- 
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eral things might be done. A qualified professor might lecture on the 
topic, or a practicing administrator might be invited in to tell how he 
schedules his work. Class discussions on ways of organizing work might 
be profitable. While these activities may have some training value, it is 
doubtful how effective they would be in improving on-the-job work- 
scheduling habits of principals. 

A more effective procedure is suggested by the way in which this 
research study was conducted. If the in-basket tests revealed the factor 
of Organizing Work, why not use them to teach the performance factor? 
The procedure would be relatively simple: Put students into a simulated 
school situation and present them with a large number of in-basket items. 
The students could work through the items first; then their work could 
be examined to determine their skill in organization, and remedial in- 
struction could be given. Various types of instruction might have value. 
Each student might report on how he organized his work. It probably 
would be found that some students did each item in the same order in 
which they were arranged in the in-basket. Others would have read each 
item and arranged them in groups on the basis of priorities. Still others 
would have prepared calendars or guide sheets for work scheduling. If 
these procedures did not emerge, the instructor could call attention to 
them. Issues will emerge in the discussion. Why did some students han- 
dle certain items immediately while others put them off for a week or 
more? On what bases does one make choices as to what is done and at 
what times? 

The difference between this approach and the more traditional ways 
of teaching is clear. Rather than discussing the topic in the abstract, the 
student does work on a sample of realistic problems and has the oppor- 
tunity to review his work and compare it with the work of others. He is 
then in a position where he can talk and think about his work, about his 
actual performance, rather than listen to someone discuss hypothetical 
problems in the abstract. 

Organizing Work is a good illustration of one type of activity sug- 
gested by the factors. Some attention to organizing work is doubtless 
desirable—at least up to a point—and can be taught directly through the 
use of the in-basket technique. Other problems in the use of in-basket 
tests in training are suggested by Factor C, Complying with Suggestions 
Made by Others. The principals who score high on Factor C appear to 
listen to teachers, superiors, and outsiders when a problem is identified, 
and then through a process of reasoning arrive at a solution. These 
principals may or may not depend on knowledge of professional educa- 
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tion or objectives of education for guidance. The desirability of this type 
of administrative performance is open to question. It may be that this 
is a type of performance that professors would want to discourage in 
their students. Much the same teaching procedures could be used with 
Factor C as with Organizing Work. Once the student has completed a 
task from the in-basket and his work has been examined, the instructor 
could point out how a different solution might have been arrived at if 
the student had relied on knowledge or objectives rather than on a sug- 
gestion made by another. 

The materials of this study have been used in workshops on school 
administration at three universities: University of Chicago, Stanford 
University, and Teachers College, Columbia University. The experience 
gained in these three graduate schools is described in a bulletin published 
by the University Council for Educational Administration.? Workshops 
were established at each university with varying types of students. Dif- 
ferent emphases were employed at each location, and the workshops 
were evaluated in various ways. 

As a result of this “tryout” a set of strengths and limitations of simu- 
lation as a training device was developed. These are paraphrased be- 
low:1° 


STRENGTHS 


1. Since simulation presents representations of real administrative situ- 
ations, the likelihood of desired transfer of learning to on-the-job 
situations seems to be much more probable with them than with 
conventional teaching materials and methods. 

2. Simulated materials seem to be ideal for developing an ability to “see 
the total picture,” since the student continually examines specific 
problems in relationship to their total context. 

3. By starting with a representation of real administrative situations, 
greater responsibility will be placed on the instructor to relate theory 
and fact. Students will . . . have better opportunities to evolve 
meaningful relationships between concepts and facts. ... 

4. A weakness of traditional programs of preparation is that they deal 
with what ought to be rather than what is. The use of simulated ma- 
terials can help to maintain a balance between what ought to be and 
what is. 

5. Simulated materials help a student develop insights about himself, 
learn scientific concepts, and acquire needed skills. 

6. Simulated materials are realistic and at the same time susceptible to 
the control of the instructor. 


° Simulation in Administrative Training (Columbus, Ohio: University Council 
for Educational Administration, 1960), 46 pp. 
* Ibid., pp. 39-44. 
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LIMITATIONS 


1. The effective use of any materials depends on the person directing 
the learning situations. Simulation cannot . .. overcome the ill 
effects of poor teaching. 

2. Since simulation is so new as a teaching technique in school adminis- 
tration, there is no body of experience from which instructors can 
gain help. Many professors are apt to stumble from lack of help. 


Those who have used simulation are enthusiastic in support of its 
use in instruction. 


THE PRACTICE OF ADMINISTRATION 

Leadership. Current literature in school administration has stressed 
the leadership aspects of administration, particularly in relation to the 
principalship. The impression has been created that “leadership” and 
“administration” are synonymous. Some of this is no doubt the result 
of the failure of authors to make clear distinctions between leadership 
and administration. Factor H, Directing the Activities of Others, is more 
closely related to the common notion of “leadership” than any one of the 
other factors. It is characterized by “leading action,” “courtesy to sub- 
ordinates,” and “gives directions and/or suggestions.” Such behavior 
is not clearly leadership behavior. Perhaps some form of leadership may 
be implied in such factors as Exchanging Information, Discussion before 
Acting, or Maintaining Organizational Relationships. The fact is that a 
clear “leadership” factor did not emerge from the study. 

The study provides no reason to question the prescription that 
principals “ought” to be leaders and that leadership should be an im- 
portant part of the principals’ work. However, the study indicates that 
administrative performance is much more than leadership, and that when 
leadership is stressed to the exclusion of other aspects of administration, 
an incomplete picture is presented. 

Content of the Job. A study of what the principals did not stress 
in their work is of interest to practicing administrators. Twelve of the 
in-basket scoring categories had mean scores of less than one. In other 
words, out of 96 opportunities to display the behavior defined by the 
category, the behavior on the average occurred less than once. What 
kinds of performance are covered by these 12 categories that tended not 
to be employed? 

Most theories of administration recognize one major aspect of ad- 
ministration to be that of control. Administrators generally employ some 
means of assuring themselves that what they want done is actually done, 
that they get some form of feedback or report on the progress of work 
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on assigned tasks. This type of performance was covered by two of the 
infrequently used categories: “‘sets a deadline” and “follow-up or feed- 
back planned.” In general, the principals failed to demonstrate that they 
were aware of these forms of administrative control. Why they failed 
to do so is a matter of speculation. It may be the type of control covered 
by these scoring categories is not the type actually employed by ele- 
mentary school principals. A further possibility is that principals do not, 
in fact, use control, although this seems far-fetched; one has difficulty in 
picturing a social institution in which controls do not exist. A third 
possibility is that the authority structure of elementary schools is so 
strong that principals have a type of implicit control—that is, when re- 
quests are made or directions are given the desired response is automatic. 
Perhaps the principals do not employ the overt and obvious control 
techniques; the controls they employ may be of the less obvious and 
more informal type. It is a well-documented fact that the more powerful 
the controls, the less obvious are their manifestations." 

The next set of little-used scoring categories tends to add some 
credence to the notion that the school is a highly formal organization 
with strong authority orientation. Two categories, Informality to Out- 
siders and Informality to Superiors, were almost never used. Further, 
there was little or no evidence of behavior indicating informal work with 
superiors, i.e., of explaining actions to superiors or referring to superiors. 
The total picture is that of the principal working largely independently 
and initiating little interaction with his superior. Perhaps the principal 
does not consider his superior as a counselor or advisor but as his “boss,” 
a person with whom he has a strictly formal relationship. 

Another set of unused categories is also of interest. The set includes 
Improves Working Conditions, Improves Staff, and Backs Up Staff. The 
principals gave practically no indication of being interested or concerned 
with the well-being of their teaching staffs. While this lack of concern 
may be an artifact of the simulation, the lack is so nearly complete that 
it does not seem as though this is the only reason. This performance con- 
trasts with the relatively high use of courtesy toward subordinates; but 
it is likely that the use of courtesy is another example of formalism. 
Principals can be formally courteous toward subordinates without dem- 
onstrating concern for them in terms of backing them up, improving 
working conditions, or improving staff. 

Writers on school administration have, for a number of years, rec- 

“For a discussion of this point see Daniel E. Griffiths, Human Relations in 


School Administration (New York: Appleton-Century-Crofts, 1956), Chapter 6, 
“Human Relations and Authority.” 
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ommended that principals delegate more to their subordinates. Three 
scoring categories relating to delegation were employed in the scoring 
of in-basket responses: Delegates Completely, Delegates Partially with 
Control, and Delegates Partially without Control. Delegation was defined 
as deputizing, that is, asking someone else to do what one might be ex- 
pected to do himself. The mean score on Delegates Completely was .75; 
on Delegates Partially with Control, 1.15; and on Delegates Partially 
without Control, 2.89. The most obvious conclusion is that there is little 
delegation in the elementary school. It would further seem reasonable 
that little delegation should be expected, since principals generally have 
no one to whom to delegate except teachers, who have full-time jobs. 
Delegation should not be expected in elementary schools until the 
schools are staffed with personnel to whom principals can delegate. 

One of the stereotypes of the elementary school principal that is 
widely held presents the principal as “a school housekeeper whose major 
function is picking up after others.”!* Three scoring categories were de- 
vised to get at the values held by principals in regard to the basis for 
reaching decisions: Uses Human Values, Uses Program Values, and Uses 
Physical Values. It was reasoned that if the stereotype was correct, the 
principals frequently would use physical values in analysis of the items. 
The category was scored when concern for buildings, property, and 
equipment was expressed. The mean score for the category was .27, 
the third lowest score for any one of the categories. 

The stereotype is further questioned by scores on the Instructional 
Awareness Categories and Job Performance Values which were used to 
score responses to the kinescopes and the tape recordings (see Chapters 
9 and 10). In each case the categories related to physical values had low 
scores, although scores relating to human values were much higher. It 
would appear that the stereotype of the elementary school principal as a 
“housekeeper” is not justified in terms of the findings of this study. 

Elementary school principals apparently do little that could be called 
coordination. This category had a mean score of .61 for the three school 
in-baskets. The principal would have received a score if he had at- 
tempted to arrange activities so that they interlocked, promoted effi- 
ciency, or avoided conflict. Again, this low score may reflect the nature 
of the school as an organization. The Whitman School was committed 
to the “self-contained classroom concept” in which each teacher taught 
all subjects. Consultants were employed to help teachers, but since the 

* Cooperative Development of Public School Administration, The Ele- 


mentary School Principal and Director (Albany, N.Y.: State Teachers Associa- 
tion, 1956), p. 4. 
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consultants worked on schedule there was little need to coordinate ef- 
forts. It may well be that coordination is a concept not particularly 
appropriate to describing the performance of the elementary school 
principal. The fact that the mean score for the Bureau of Business in- 
basket was only slightly higher (.37 vs. .20 for the average school in- 
basket) indicates that it was not too appropriate for this particular type 
of business situation either. 

Evaluation of Principals. It is a rare textbook in the field of edu- 
cational administration which discusses the evaluation of the elementary 
school principal. There may be good reasons for this omission. Very 
little research has been done, and few school systems use formal evalu- 
ation systems for principals. The results of this study indicate that 
school districts might well consider introducing a system of formal eval- 
uation of principals. 

Although this study employed four different classes of raters, only 
two of these would be available to a school district—superiors and sub- 
ordinates. The ratings were not the same for each class of judges, but 
they may be thought of as complementary. Superiors apparently look 
for characteristics not seen by teachers, and vice versa. 

One of the first questions raised when evaluation of personnel is 
discussed is, How reliable are the instruments? As reported in Chapter 
11, the reliability of this over-all rating of principals was .85 when used 
by superiors who were confident of their ability to judge a principal’s 
work. For superiors who were less confident of their ability, the re- 
liability was .74. The reliability of a rating is, at least in part, dependent 
on the familiarity of the judge with the person being rated. Teachers 
used two forms to rate their principals. The Principal Behavior Descrip- 
tion Questionnaire had a reliability of .83 for each of its two scores, and 
the Teacher Reaction Form had a reliability of .82. The reliabilities on 
all three instruments are judged sufficiently high to be useful to a school 
district. 

When ratings of superiors and subordinates were compared, the re- 
sults were similar to those of several other studies: Superiors and subor- 
dinates hold conflicting expectations of leader behavior.!* It was found 
that ratings of superiors stressed the nomothetic dimensions of adminis- 
tration, while teacher ratings emphasized the idiographic dimension. 
Superiors tended to rate higher those principals who demonstrate an 
ability to get along with superiors, know administrative practices, show 


* Stephen Hencley, “Theories on Behavior of School Leadership” in Overview, 
December, 1960, pp. 28-30. 
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interest in their work, demonstrate the capacity to stick to the job, un- 
derstand written communication, and have knowledge of teaching meth- 
ods and techniques. Teachers, however, rate higher those principals who 
demonstrate ability to get along with teachers, pupils, and parents, and 
who show good informal oral communication skill. 

It would seem that the judgments are not antithetical and that a 
superintendent, in evaluating the performance of a principal, would 
want both viewpoints. Ratings of the superiors of the principal hold 
higher those who operate “by the book,” while ratings of teachers hold 
higher those who behave in terms of the people in the situation. 


THE ROLE OF THE PROFESSION 


Without getting into the question of whether school administration 
or administration in general is a profession, or even whether education is 
a profession, there are implications for professional activities in this 
study. There is really only one test of professionalism and that is public 
acceptance. A group of practitioners of an art can proclaim to the 
heavens that they constitute a profession, yet if the public does not hold 
a similar view the talk is for naught. This point of view is discussed by 
Hearn:14 
Practice is professional to the extent that it is sanctioned by society. Such 
sanction to practice and to educate for practice is earned as a field demon- 
strates its ability to perform its prescribed functions with integrity, knowl- 
edge and skill. To act with professional integrity is to act consistently within 
a framework of values that is shared generally by the members of the pro- 
fession. To act with knowledge is to act with an awareness of the rationale 
and probable consequences of one’s actions. To act with skill is to exercise 
such contro] that one’s actions more closely approximate one’s intentions. 
Thus, professional practice is a combination of believing, knowing and doing. 


It can be said, in terms of Hearn’s statement, that a profession exists 
in order to define and redefine value assumptions upon which practice is 
based, to extend knowledge, and to help its members acquire and ex- 
tend their skill. This discussion of implications for professional action is 
in terms of the three processes discussed above. 

Professional Values. Probably the most important task of a pro- 
fession is to establish the pattern of values by which each practitioner 
can evaluate himself. The profession should say what is a good princi- 
pal. It is true that professional associations in school administration 
have attempted to do this in the past, but their language has been 


* Gordon Hearn, Theory Building in Social Work (Toronto: University of 
Toronto Press, 1958), p. 1. 
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couched in general terms and has tended toward slogans rather than 
definitions. 

It is suggested that the professional association reconsider the possi- 
bility of defining the “good principal,” employing concepts such as those 
developed in this study. The advantage in this approach over others 
tried in the past is that the profession has the opportunity to approve or 
disapprove of specific aspects of performance rather than making global 
judgments in terms of generalities that glitter. Not only does this study 
isolate the factors of performance, but it also supplies interpretative data 
so that the profession can see what the factor is related to. 

The profession should also address itself to questions concerning 
priorities in performance. On what should the principal spend most of 
his time? Where should he put major emphasis? Should he stress Re- 
sponding to Outsiders or Maintaining Organizational Relationships? 
Should he Direct the Work of Others or should he emphasize Exchang- 
ing Information? Since some of the factors are essentially incompatible, 
some choice should be made as to which takes precedence over others. 

This study has described the performance of principals in terms of 
a set of factors. It is now the task of the profession to determine which 
of the aspects of performance it wishes to promote and which it would 
like to diminish. The profession can do this by describing what it con- 
ceives to be the good principal. This should be done definitively and 
with carefully worked out priorities. 

Professional Knowledge. The second major task of a profession is 
to assure its practitioners of a body of knowledge which will enable 
them to be familiar with the consequences of their actions and the ra- 
tionale for their acts. This is an assertion that a profession has a re- 
sponsibility for the development and constant appraisal of knowledge of 
school administration. 

The implications of this study for the role of the profession lie in 
two directions. On the one hand there are implications concerning the 
nature of the knowledge and on the other, concerning the methodology 
involved in gaining the knowledge. This study has made a start in de- 
termining a body of psychologically oriented knowledge about adminis- 
trative performance. Such aspects as factors of performance; abilities, 
interests, and professional knowledge; personality; educational concerns; 
interaction data; biographical data; and ratings of reference groups have 
been explored and presented. The profession needs to look at perform- 
ance in terms of other of the behavioral science frameworks. Perform- 
ance can be better understood if it is explored in a variety of ways. It 
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is the responsibility of the profession to see to it that more comprehen- 
sive researches are undertaken so that its body of knowledge is being 
constantly enlarged and revised. 

The methodology of this study is a sharp break with past research. 
There is no doubt that simulation is highly useful in the study of admin- 
istrative performance. While the profession should encourage its use, 
it would do a greater service if it encouraged researchers to develop new 
methods which might be even more useful. Investigation into adminis- 
trative performance is still in its infancy and its methodology still needs 
to be developed. 

Professional Skill. The third responsibility for a profession is to 
improve the skill of its members. The development of professional skill 
is more urgent in school administration than in many other professions 
because of the admitted inadequacy of preservice preparation. Scarcely 
a yearbook of any of the major educational administration organizations 
in the past several years has failed to comment negatively on preparation 
for administrative positions. 

Skill in administration has many connotations. It refers to the 
ability to handle technical, human, and conceptual problems at a most 
practical level. Unfortunately, most of the preparation programs “talk 
about” administration rather than actually immerse students in the life 
blood of administration. Inservice programs have tended to do the same 
for practitioners. Conventions feature speeches and call only for per- 
formance as “spectators” on the part of attendees. 

The major implication of this study is that simulation offers an ex- 
cellent method of teaching skills to administrators. While the use of 
simulation as an instructional device was not studied, the reaction of the 
subjects to the technique was enthusiastic and the principals in the study 
suggested it be used for instruction. While, as indicated above, simula- 
tion might well be used in the preparation of administrators, it may be 
more applicable to the inservice education of school principals and su- 
perintendents. Much more work needs to be done to use simulation 
most effectively in instruction and this is the responsibility of the pro- 
fession. 


A LOOK AHEAD 


The short section that follows will consider briefly (1) implications 
of the study for a better scientific theory and (2) implications for future 
research. 

It has been said that there is nothing as practical as a good theory. 
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Progress toward an adequate scientific theory of school administration 
depends on the creation of suitable concepts by which empirical observa- 
tions of events, situations, and processes of administration can be 
brought into a meaningful order. The practice of administration will 
improve only as the administrator can analyze, understand, and change 
his manner of performance of his job to correct an error about which he 
becomes aware. Analysis, understanding, and efforts to change behavior 
are dependent on the existence of valid concepts by which specific inci- 
dents and events may be recognized as examples of more general classes 
of events, or are the result of the operation of general principles. Al- 
though much of administrative practice may remain an art in which skill 
develops with experience, the rate at which one attains skill in the art 
will depend on the administrator’s ability to learn from experience. 

There is reason to question how much the elementary school princi- 
pal is learning today from either experience in graduate training or on 
the job. The study reveals little or no substantial relationship of years 
of administrative experience or years of academic preparation with any 
measure of performance in the simulated school situation. This state of 
affairs strongly suggests that those who are practicing school administra- 
tion, as well as those who are teaching it, are in need of better concepts 
by which they may analyze, evaluate, understand, and improve perform- 
ance. 


IMPLICATIONS FOR THEORY 


It has already been suggested that many of the findings of the study 
have implications for the development of better theory in educational 
administration. It is also possible to find suggestions in the study for 
theories of the function of abilities and personality variables in determin- 
ing performance of complex tasks. There are implications with respect 
to scientific methodology, especially as to how the methods of simula- 
tion and factor analysis may be concerned. It is not possible within the 
scope of this report to treat these implications in other than the most 
superficial way. No attempt will be made to present a complete theory 
of administrative performance. 


IMPLICATIONS FOR FUTURE RESEARCH 


Research is characterized more by its tendency to raise new prob- 
lems for further research than by its tendency to provide solutions for 
old problems. Although this study is one of the more comprehensive 
ones in the area of school administration, it is no exception to the gen- 
eralization. 
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This section of the report notes some implications for future research, 
and discusses three areas briefly: (1) the desirability of replicating the 
study, (2) criterion research, and (3) research on personality. 

Replication with Variation. There are many reasons why the pres- 
ent study should be replicated that go beyond a general desirability of 
repeating all research. The most useful replication would require not 
only that a new group of principals be selected as subjects for study but, 
also, that a different school situation be developed. Whitman School 
is but one of an almost infinitely large number of “schools” that might 
have been simulated. If a different school were selected for a repetition 
of the study, it would be necessary to create new background materials 
and new administrative problems (in-basket items, kinescopes, etc.) 
which would be appropriate in the new school. Replication of the study 
by using a new group of subjects and a new school situation would pro- 
vide the opportunity to study the effects of variations in samples of 
subjects and variation in simulated situations on the more important 
findings of the study. The general question to be answered is, “To what 
extent are the dimensions of performance found in this study a function 
of (1) the specific school situation (e.g., Whitman School), (2) the spe- 
cific principals studied, or (3) the interaction between the principals and 
the school situation?” The last part of the question, i.e., the possibility 
of an interaction effect between the characteristics of 232 principals and 
the characteristics of Whitman School, is of particular significance. The 
present study suggests that ability and personality characteristics of 
principals are related to how they perform administrative tasks in at 
least one school (Whitman), but does not show unequivocally that such 
relationships would appear if a second or third school situation were 
involved. No information is provided about the possibility that new 
dimensions of performance would be found in a different school situation. 
The simulation technique provides a vehicle for experimental work on 
effects of situational variables. It would be possible to vary systemati- 
cally certain aspects of the situation, such as the personality of the super- 
intendent or the type of organization of the school district, and observe 
the changes in administrative behavior. One very important course for 
future research in educational administration is to replicate the present 
study with variations in the sample of subjects and the nature of the 
school situation. 

There is need for “reality” testing of the dimensions of administra- 
tive performance found in this study. Do the principals perform their 
everyday administrative tasks in their real schools in the same manner 
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as they perform comparable tasks in a simulated situation? A check 
list of dimensions could be prepared with operational definitions based 
on the appropriate in-basket test scoring categories, and a small repre- 
sentative sample from the principals in the original study could be 
selected for detailed study. Observers could then visit the schools of 
these principals to determine the extent to which each principal dis- 
played the same administrative performance in his everyday work as he 
had exhibited in Whitman School. 

The Criteria. The study has implications for future research con- 
cerned with the development of criteria of performance in complex situa- 
tions. If it can be concluded that the dimensions of administrative per- 
formance reported in Chapter 7 cover significant areas of the work of the 
elementary school principal, a necessary first step toward development 
of performance criteria has been taken. These dimensions suggest the 
major areas within which it would be desirable to obtain an appraisal of 
the principal’s performance. The study brings into focus two additional 
problems relative to criterion development: (1) the complexity of the 
criteria, and (2) the multiplicity of value questions. 

The question, “How can we know how well a complex job is being 
done?” will not be answered in a simple manner. No single over-all 
measure of quality of performance is likely to be found that wili suffice. 
An answer to the problem of criterion development must provide room 
for understanding the individual who performs well some parts of a com- 
plex job, but does less well in the case of other parts. 

Despite indications that it will be rare for an individual principal’s 
performance to be described as uniformly “good” or “poor” in each 
part of his job, it will always be necessary to appraise and select the in- 
cumbent individual as an indivisible unit. This implies that most prin- 
cipals will probably be stronger in some areas of performance than in 
others. Job situations may likewise be expected to show variations in the 
demands that they create for excellence of performance in different 
areas. This leads directly to the possibility of selecting and placing the 
principal in a job situation that fits his particular strengths. Thus, the 
criterion problem in complex situations involves the analysis of job de- 
mands as well as the individual’s performance. 

The present study has in no way contributed to the solution of the 
problems of describing or measuring differences between administrative 
situations within which different elementary school principals function. 
The use of simulation as a research approach directly reflects the re- 
search staff members’ recognition of situational differences, but serves 
to control rather than to investigate these differences. Appropriate re- 
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search that is designed to lead to the determination of the major dimen- 
sions of administrative situations (as contrasted with dimensions of ad- 
ministrative performance) in the elementary school is definitely indicated 
for the future. It may well be that an extended use of simulation would 
help to solve this problem. A number of situations could be simulated 
for study while the sample of individuals was held constant. 

A question of tremendous importance to administration is, “Do the 
dimensions of administrative performance change with levels of the ad- 
ministration position?” For example, would superintendents, when faced 
with an appropriate simulation of the superintendent’s job, display pat- 
terns of administrative performance that require different dimensions for 
their description than are found for elementary school principals? Simi- 
lar questions should be raised concerning secondary school principals, 
school business officials, and central office administrators. 

The study has shown that the answer one can expect to the question, 
“How effectively is Principal X performing his job?,” will depend, in 
large degree, on the person being questioned. The principal’s superiors, 
his subordinates, and the patrons of his school will probably give some- 
what different answers. This fact, indeed, raises very serious questions 
with respect to criteria of performance. While findings from the study 
have added to the understanding of the problem of the judge in evaluat- 
ing performance, much more research is needed. There are at least two 
important directions to which such research could be addressed. One 
direction is to determine the kind and the extent of differences in values 
or point of view between relevant groups of persons who form judg- 
ments about the performance. For example, what precisely are the dif- 
ferences between teachers, on the one hand, and superiors, on the other, 
with respect to how the excellence of a principal is to be judged? Do the 
members of these reference groups use different personal values in form- 
ing judgments? The second direction of investigation would be con- 
cerned with the possibility of differences in what is perceived as the 
principal’s job. The finding of little or no correspondence between the 
superior’s impressions of a given principal and his teachers’ impressions 
may be explained in several ways, but certainly includes one or more of 
the following: 


1. The judges evaluate the same performance differently. 

2. The judges consider as relevant, for purposes of evaluation, dif- 
ferent types (dimensions) of performance. 

3. The judges have different opportunities to observe different areas 
of performance. 
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4. The different research instruments introduce different errors or 
biases into the reports of the judges. 


Other investigators! have been concerned with problems of understand- 
the performance of school administrators in relation to the demands of 
different reference groups, but much more research of this kind is 
needed. 

Personality. One of the more striking findings of the study is the 
appearance of many orderly relationships between personality factors 
and performance of the principals in the complex situations in Whitman 
School. Such findings were somewhat unexpected in view of the gen- 
eral difficulty of demonstrating relationships between measures of per- 
sonality variables and job performance which has characterized much 
past research. Although intuitively it seems necessary that variations in 
personality should be expressed in job performance, progress toward 
achieving understanding in this area has been meager. The lack of 
progress may be due, in part, to methodological problems, which this 
study has made somewhat clearer. 

From the point of view of methodology, the study suggests that in 
investigating relationships between personality variables and perform- 
ance variables: 


1. The performance variables must be relevant; i.e., must permit 
the expression of personality tendencies. 

2. It must be possible to observe and compare performance within 
a standard situation. 

3. Data analysis procedures must be appropriate to the complexity 
of interrelationships that are expected to be found between variables. 


Each of these methodological requirements will be considered in 
turn. In this discussion it is assumed that valid techniques for measur- 
ing personality tendencies are or can become available, and that there 
are many problems in personality research which do not fall within the 
restricted area discussed here. 

The type of performance variable which is relevant to the expression 
of personality tendencies is likely to be “stylistic” rather than “evalua- 
tive.” Variables reflecting performance that is highly evaluative are 
those to which social pressures tend to force conformity and, hence, to 
restrict the possibility for expression of individual differences. If the 


1’ For example, see Neal Gross, Ward S. Mason, and Alexander W. Mc- 
Eachern, Exploration in Role Analysis: Studies of the School Superintendency Role 
(New York: John Wiley & Sons, Inc., 1958), 379 pp. 
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measure of the variable is one involving a large amount of evaluation, 
and is at the same time obtained in a manner which entails a judgment 
by an observer, it is likely that the measure will be contaminated by the 
value frame of reference of the observers (e.g., teachers, superiors, and 
outsiders did not agree about the over-all quality of the principals’ per- 
formance). 

The dimensions Complying with Suggestions Made by Others, Or- 
ganizing Future Work, and Maintaining Organizational Relationships 
are examples of “stylistic” performance variables that were found in 
the present study to show definite relationships with measures of per- 
sonality factors. These dimensions of performance are not readily co- 
ordinated with the evaluation continuum ranging from “good” to “bad.” 
An excess of any one of these performance factors might be considered 
undesirable, as might a deficiency. Different judges are likely to evaluate 
the three dimensions of performance quite differently. The principals, 
therefore, may find an opportunity to express personality tendencies in 
these areas. In fact, the study results are definitely in the direction 
which previous empirical and theoretical work in the area of personality 
might have predicted. The pattern of results shows that Complying with 
Suggestions Made by Others is associated with the general personality 
characteristics and cognitive ability patterns described by Witkin!® and 
others as related to “field independence.” Maintaining Organizational 
Relationships appears to be related to a well-known general personality 
characteristic “introversion-extroversion” which has recently appeared 
as a second-order factor in Cattell’s work.!” The dimension Organizing 
Future Work shows a pattern of relationship with personality scores re- 
flecting anxious, compulsive tendencies. This pattern has also been recog- 
nized by Cattell as a second-order personality factor. 

One major difficulty facing personality research that is concerned 
with relationships between personality tendencies and performance of 
complex, real-life tasks has been that of making suitable real-life obser- 
vations. It seems clear that not every real-life situation will provide op- 
portunities for the expression of any or all personality tendencies. Be- 
havior, as seen by an observer in real life, and about which he makes 
inferences concerning an individual’s performance, is a function of both 
the situation and the person. Observations in real life will be con- 
taminated in very complex ways by the mixture of situational and per- 
sonal variables which enter into the behavior that is observed. Clearly, 


1H. A. Witkin, “The Perception of the Upright,” Scientific American, Vol. 
200, No. 2, February 1959, pp. 50-56. 
™ Raymond B. Cattell, op. cit. 
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personality research in the area under discussion could be expected to 
progress more rapidly if performance could be observed in a situation of 
sufficient complexity to permit the expression of personality tendencies, 
but which, at the same time, could be controlled in a manner which pro- 
vided the same opportunity to display personality tendencies for all in- 
dividuals under study. Simulation, as used in the present study, can 
provide such a standard situation. 

Without elaborating, it appears that both the personality tendencies 
and performance variables that are involved in a reasonably complex job 
situation (or an adequate simulation of such a situation) are likely to 
be numerous. The variables are also likely to interact with one another 
in a manner that obscures their basic relationships. It follows that the 
procedures for analysis of data obtained in such situations should be 
sufficiently sophisticated to reveal the basic underlying order that may 
exist. 

These suggestions for directions of future research in educational 
administration are in no way exhaustive. They demonstrate the tentative 
and limited character of research findings, even those from relatively 
ambitious investigations. They emphasize the size of the task that re- 
mains in the search for an understanding of administrative performance. 
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CHARLES C. HARMANY OTIs J. ROTHENBERGER 
DorROTHY P. HARTMAN MARY TURCZYN 

PAUL M. HEAGER ROBERT UNSER 

PAUL R. KRAMER Mary E. WAGNER 
FLORENCE E. MOCK ROBERT WELLIVER 


ANN ARBOR, MICHIGAN 


MARION CRANMORE HAZEL JUNGQUIST 
ETHEL HEDRICK MARGARET MATTESON 
LEONARD B. HoaG ROBERT H. NICHOLS 


BALTIMORE, MARYLAND (first week) 


WINIFRED E. BARRETT WINIFRED KINN 
ELLA BEALL LypiA R. LUTZ 
VIVIAN I. CorD ELIZABETH K. MAYER 
GENEVIEVE EMERINE CLIFTON S. MURRAY 
ELIZABETH B. Fox ROLENA C. NEELS 
RUBY GROOMS MILDRED B. PIERSON 
LEROY HARDESTY VIOLA SMITH 
ELIZABETH HARTJE MILDRED E. TYSON 
MARY HORSEY S. REGINALD WATTS 
NEUBERT JAFFA HENRY N. WEST 
HAROLD KATZ THOMAS J. WHEADEN 


KATHALEEN KENNEDY 


380 


APPENDIX B 381 
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PEARL BRACKETT 
EMMA BRIGHT 
MARY BROOKS 
JACK EPSTEIN 
MILDRED FOWLER 
EDWARD GERSUK 
EVELYN GIRARDIN 
JOHN GRAYBILL 
ELLEN GRIFFITHS 
ELIZABETH GUERIN 
ROSELLA HERMAN 
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RUTH B. BODINE 
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CARRIE SISSALA 
WILLIAM A. WARNOCK 


GEORGIA L. MEAD 
FRANCES SAUBER 
DARENE T. SESSIONS 
HAROLD R. Woop 


GEORGE WILLIAMS 
LUTHER H. WILLIAMS 


S. EDWARD WEINSWIG 


ROLLAND PERRY 
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MODESTO, CALIFORNIA 


PHIL LINE LESTER TOOKER 
ALBERTA MARTONE Eva WYLDE 
SAMUEL RENTERIA 


Mt. Diablo Unified School District, CONCORD, CALIFORNIA 


LEONARD R. BAXTER ROBERT REASONER 
ROBERT LOVEJOY LLoyp TEEL 
WILEY R. MARTIN 


NEW BRITAIN, CONNECTICUT 
WINNIE CLARK ELLEN KENNEDY 


OKLAHOMA CITY, OKLAHOMA 


FLoyD F. ALEXANDER HAZEL KIBLER 

ELDON CLAY BABER L. S. LANMAN 

RALPH A. BORAH A. J. LONIAN 

VERNON T. BREWER LENA MCKEE 

DELBERT BURNETT MYRTLE MCNATT 

R. C. CREws EARL MARTIN 

LLoypD M. ESTES MARY ELIZABETH MOULDER 
W. L. GEIS CARL C. RUBLE 

JACKSON GIBSON J. OTIS SCOTT 

GEORGE T. GLOVER FRANCIS C. THOMAS 


ORANGE COUNTY, FLORIDA 
FELIX E. CosBy WILLIAM S. MAXEY 
GEORGE W. ForT W. V. NIXON 


PINELLAS COUNTY, FLORIDA 


FREDERICK D. BURNEY WILLIAM G. THOMPSON 
JOHN H. HopkKINs O’CAIN J. THUMBTZEN 
Louis W. McCoy 


PORTLAND, MAINE 
FREDERICK JEFFERY ELEANOR SANBORNE 


SAN RAFAEL, CALIFORNIA 


EDWINA CODONI HOMER E. Hoyt 
HAROLD DELMA WILLIAM M. SEWELL 
LAWRENCE GEIGER 


SMITHTOWN, NEW YORK, Central School District 
WILLIAM VAN DER MEULEN PHILLIP L. SMITH 
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TACOMA, WASHINGTON 


ALFRED A. ACTOR E. GOODWIN OLSON 
RALPH BAIRD DALE E. OVERFIELD 
Harry A. ERICKSON MYRLIN N. PARKER 

Otis J. GRANDE HAROLD G. PETERSON 
RICHARD G. HAGERTY HAZEL H. PFLUGMACHER 
C. WILFRED JEWELL G. E. RAMSEY 

LEIF C. KLIPPEN CHARLES F. TOTTEN 
RUTH N. MCCONIHE RUTH TROSPER 

WILLIAM D. MELVILLE INGVAL M. ULBERG 
LESLIE A. NELSON DONALD E, WILLIAMS 


TARRYTOWN, NEW YORK 
JAMES MITCHENER 


UNIONDALE, NEW YORK, Northern Parkway School 
STEWART A. LINDEN 


WARWICK, RHODE ISLAND 
Doris BETTEZ MARGARET A. HALEY 


WILLOUGHBY, OHIO 


EDNA BENSON LENORA D. LOGAN 
WARD W. CARHART WILBUR S. MILLER 
MARGUERITE HAAG CHARLES NESS 
GENEVIEVE HARRISON ALBERT LEE SANFORD 


EDWARD HOPE PHILIP WRIGHT 
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1. NATIONAL ADVISORY COMMITTEE 


Mr. ARTHUR L. BENSON 
Director, National Teacher 
Examinations 
Educational Testing Service 
Princeton, New Jersey 


Dr. H. M. ELLIOTT 
Director of Research 
Oakland Public Schools 
1025 Second Avenue 
Oakland 6, California 


Dr. JAY GREENE 

The Board of Examiners 
New York City Schools 
110 Livingston Street 
Brooklyn 1, New York 


Dr. ANDREW W. HALPIN 

Director, Bureau of Educational 
Research 

State College of Education 

University of Utah 

Salt Lake City, Utah 


Dr. VYNCE HINES 
College of Education 
University of Florida 
Gainesville, Florida 


Dr. GEORGE HOLLOWAY 
School of Education 
University of Buffalo 
Buffalo, New York 


Dr. O. W. Kopp 

Department of Elementary School 
Principals 

National Education Association 

1201 Sixteenth Street, N.W. 

Washington 6, D.C. 


Dr. RICHARD LONSDALE 
School of Education 
Syracuse University 
Syracuse, New York 


MR. E. N. LUCE 

National School Boards Associa- 
tion, Inc. 

450 East Ohio Street 

Chicago 11, Illinois 
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Dr. HOLLIS MOORE 


American Association of School 


Administrators 
1201 Sixteenth Street, N.W. 
Washington 6, D.C. 


Dr. KENNETH E. MCINTYRE 
Executive Director 

School Principalship Project 
The University of Texas 
Austin 12, Texas 


Dr. HAROLD J. MCNALLY 
Professor of Education 
Teachers College 
Columbia University 
New York 27, New York 


Dr. KENNETH E. OBERHOLTZER 
Superintendent of Schools 
Denver Public Schools 

414 Fourteenth Street 

Denver 2, Colorado 


Mr. ELLSWORTH TOMPKINS 

Executive Secretary 

National Association of Secondary- 
School Principals 

1201 Sixteenth Street, N.W. 

Washington 6, D.C. 


Dr. RICHARD WYNN 
Associate Dean 

School of Education 
University of Pittsburgh 
Pittsburgh, Pennsylvania 


2. PRINCIPALS’ ADVISORY COMMITTEE 


HAROLD AHLQUIST 
Elementary Principal 


Hastings-on-Hudson, New York 


AL ATWAN 

Elementary Principal 
Saddle Rock 

Great Neck, New York 


JOSEPH AZZARELLI 
Educational Administration 
Teachers College 

Columbia University 

New York 27, New York 


WINIFRED BARRY 
Elementary Principal 

Board of Education Building 
Oceanside, New York 


JAMES COLLINS 
Elementary Principal 
Rye, New York 


JOHN ETHER 


Principal, Westmere Elementary 


School 
Albany, New York 


JACK FRECK 
Lakeville School 
Great Neck, New York 


W. GEORGE HAYWARD 
Assistant Superintendent of Schools 
East Orange, New Jersey 


WILLIAM MAHONEY 

Elementary Principal 
Dryden Street School 
Westbury, New York 


LYLE Morris 
Principal, East Hill School 
Roslyn, New York 


ANN MORRISEY 
Elementary Principal 
Locust Valley, New York 


EDWARD MURPHY 
Elementary Principal 
Lynbrook, New York 


JOHN O’BRIEN 
Assistant Superintendent of Schools 
Ridley Township, Pennsylvania 


GUY QUINN 
Connecticut Farms School 
Union, Union County, New Jersey 


GEORGE RAAB 
Principal, Heathcote School 
Scarsdale, New York 


PEARL ROSENSTEIN 

Principal, Barnard Laboratory 
School 

New Haven, Connecticut 


PAUL ROSSEY 
Elementary Principal 
Dobbs Ferry, New York 


ANN RUDDY 

Principal, Public School #125 
West 123rd Street 

New York 27, New York 


RICHARD T. SAWYER 
Coordinator of Instruction 
Goshen, New York 


APPENDIX C 387 


MARIA SCIAN 

Elementary School Supervisor 
Westfield Public Schools 
Westfield, New Jersey 


WILLARD SMITH 
Principal, Ridge Street School 
Rye, New York 


DUDLEY SNYDER 
Elementary Principal 
Valley Stream, New York 


MARTHA STERNAL 
Principal, Seeley Place School 
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NATHAN STOLLER 
Elementary Principal 
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Appendix E 


OVER-ALL RELATIONSHIPS AMONG THE MAJOR AREAS 
OF THE STUDY 


IN CHAPTER 13 THE RELATIONSHIPS AMONG THE VARIOUS VARIABLES DEVELOPED 
in the study were viewed from a framework provided by the factor analysis 
of in-basket test performance. This procedure is justified in view of the 
central position of the in-basket test situation within the entire study. Never- 
theless, such a choice of point of view or framework is an arbitrary one, 
since it would have been possible to select any one of the other major areas 
of the study for this same purpose. For example, the five factors in the 
ratings of the principals made by the superiors (described in Chapter 11) 
might have been used in the analysis in a manner paralleling the use that 
was made of the in-basket test factors. The choice of the factors in in- 
basket test performance as the framework for the understanding of other 
variables is only one of the many possible points from which the data of 
the study can be viewed. 

In this appendix, the over-all relationships among the various major 
areas of the study (i.e., in-basket performance, basic mental ability test per- 
formance, superiors’ ratings, etc.) will be examined. The factor analysis 
described at the beginning of Chapter 13 provides the data for this analysis. 


ROTATION TO SIMPLE STRUCTURE 

The orthogonal factor loadings of the 120 variables on the 15 factors 
(see Table 94) were rotated objectively to simple structure by use of a high- 
speed computer. The criterion used in the rotation has been called “bi- 
quartimin”! and is a special case of a more general “oblimin” criterion? 

*John B. Carroll, “Biquartimin Solution for Rotation to Oblique Simple 
Structure,” Science, 1957, Vol. 126, pp. 1114-1115. 


* John B. Carroll, Solution of the Oblimin Criterion for Oblique Factors. Un- 
published paper. 1958. 
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which allows oblique rotation of axes and minimizes two expressions both 
of which are important in the definition of simple structure. One of the 
two expressions minimizes the sums of cross-products of squared factor 
loadings to attain low factor complexity. The other expression makes each 
column of factor loadings maximally different from every other column by 
minimizing the sums of the covariances of squared factor loadings, thus 
maximizing the differences between factors with respect to factor compo- 
sition. In the “biquartimin” case which was used in the rotations reported 
here, minimizing each of the two expressions was given equal weight in 
determining the desired transformation matrix. 

Table E-1 presents the transformation matrix which was computed and 
used to make the rotations. 

The complete oblique factor matrix which was obtained by multiplying 
the orthogonal factor matrix presented earlier as Table 94 by the above 
transformation matrix will not be presented. The loadings from that matrix 
that are significant for the interpretation of the 15 factors (A through O) 
will be reported as these factors are presented. The over-all results of the 
machine rotation can be described as extremely satisfactory, as is indicated in 
part by the fact that 73 per cent of the loadings are within the £.10 hyper- 
planes. 

The 15 factors obtained will be presented and discussed one at a time. 
All loadings of +.25 or larger will be considered for interpreting each factor. 

Factor A, General Ability to Reason and Understand, has loadings of 
+.25 or higher on 22 of the 120 variables as follows: 


VARIABLE LOADING 
General Reasoning .64 
Science and Mathematics ae) 
Flexibility of Closure 58 
Visualization 58 
Inductive Reasoning 54 
Deductive Reasoning a 
Elementary Education .48 
Word Fluency 48 
Associational Fluency 47 
Number Facility 1 45 
Number Facility 2 45 
Verbal Knowledge 44 
Social Studies .40 
Administration and Supervision’ .40 
Expressional Fluency n39 
Total Background Achievement 36 
Ideational Fluency 34 
Speed of Closure 1 ‘ail 


In-basket Scorers’ Rating ao 
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Relates to Other Materials "26 
Speed of Closure 2 yal 
Careless —.26 


This factor is clearly a general mental ability factor with primary em- 
phasis on abilities to reason and see relationships. The tests of professional 
knowledge and ability to learn new material (measured by the test on the 
background material) appear with moderately high loadings on this factor. 
The minor loadings on the two in-basket test category scores—Relates to 
Other Materials (.26) and Careless (—-.26)—are consistent with the inter- 
pretation of the factor as general ability to reason and see relationships. 

Factor B is clearly identified as Superiors’ Over-all Impression, and is 
indicated by the following loadings of £.25 or higher. 


VARIABLE LOADING 
Over-all Impression 85 
Getting Along with Superiors “7 
Sticking to a Job .74 
Interest in Work 74 
Understanding ai 
Getting Along with Parents ade 
Knowledge of Administration 1 
Getting Along with Teachers 65 
Written Communication 64 
Knowledge of Teaching .62 
Oral Communication (Informal) 61 
Rapport with Children 3 


All of the 12 superiors’ rating items that were included among the 120 
variables have high loadings on this factor, the lowest loading being .53 for 
the item Rapport with Children and the highest .85 for Over-all Impression. 
No other variable has a significant loading on this factor; the next two 
highest loadings were .17. The factor can be clearly identified as superiors’ 
over-all evaluation of the principal and may be accounted for in part by the 
familiar “halo” effect in rating. 

Factor C is a bipolar factor involving interest scores, basic personality 
factor scores, basic mental ability test scores, and professional knowledge test 
scores. It has been entitled Concern for Human Problems vs. Convention- 
ality. The following variables have loadings of +.25 or larger. 


VARIABLE LOADING 
Lawyer 58 
I. Emotionally Sensitive 50 
City School Superintendent 47 
Psychologist 43 


Nonconventional .40 
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Verbal Knowledge 37 
Social Studies 36 
Elementary Education a3 
Sex (Women) phe 
G. Character Strength —.43 
Policeman —.50 


This factor is relatively complex with respect to the different types of 
variables involved. It appears to be defined at the positive pole by interests 
or personality factors indicative of sensitivity to social and human problems 
and perhaps by an appreciation for an openminded and understanding ap- 
proach to working with people. At the negative pole this factor is defined 
by unusual regard for that which is practical, conventional, and orderly. 

Factor D, like Factor C, is bipolar and is defined by both interest and 
personality measures. It has loadings of +.25 or larger for nine of the 120 
variables. These identify a factor called Gregarious Friendliness vs. Inde- 
pendent Initiative. 


VARIABLE LOADING 
E. Dominance 48 
H. Adventurous .46 
Public Administration .46 
F. Enthusiastic 43 
Policeman .26 
A. Friendly 26 
Sex (Men) e2G 
Initiating Structure —.25 
Q,. Self-sufficiency —.37 


This factor is defined at the positive pole by dominance, adventurous- 
ness, enthusiasm, friendliness, and interest in work involving personal asso- 
ciations. At the negative pole are independence, reliance on self-sufficiency, 
and a tendency to take the initiative (Initiating Structure). 

Factor E is defined entirely by category scores from the in-basket tests. 
It has been labeled Involvement with Others in In-basket Work and appears 
to be a mixture of the previous in-basket Factors C (Complying with Sug- 
gestions Made by Others), E (Maintaining Organizational Relationship), and 
G (Responding to Outsiders). It also resembles the second-order factor 
Amount of Work. The following 12 TREES category scores have loadings 
of +.25 or higher on this factor. 


VARIABLE LOADING 
Outsiders Involved .63 
Follows Outsiders ‘$5 


Discusses with Superiors (or Outsiders) .46 
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Superiors Involved 43 
Concluding Decision 41 
Informs Outsiders 39 
Communicates Face to Face eit! 
Number of Words 36 
Follows Subordinates 34 
Prejudges my 
Uncontrolled Delegation 20 
Delays —.39 


This factor appears to resemble most closely Factor E, Maintaining Or- 
ganizational Relationship, of the original analysis of in-basket performance 
insofar as the higher-loaded category scores are concerned. It is, however, 
a much more inclusive factor and covers relationship with outsiders, superi- 
ors, and, to a lesser degree, subordinates. Both complying with their sug- 
gestions and involving them in problems, either through discussions or by 
giving them information, are entailed. 

Factor F is clearly identifiable as Effective Participation in Group In- 
teraction and with one exception is loaded only by scores from the group 
interaction problem. The exception is the rating made by staff members of 
the principals. This rating could easily have been influenced by the ob- 
servations made by staff members of the behavior of the principals during 
their work on the group problem. The following eight variables have load- 
ings of +.25 or larger on Factor F. 


VARIABLE LOADING 
Amount of Talking .66 
Presents Facts Effectively Ao) 
Makes Decisions Effectively [OD 
Attempts to Influence 9 
Frequency of Interaction 4 
Suggests New Procedures 45 
Gives Positive Information 43 
Staff Members’ Rating roy 


The first four of these variables are items from the Group Report Form 
that was completed by each participant at the conclusion of the group in- 
teraction problem. The remaining variables were produced by tabulations 
made by staff members who served as experimenters and observers. This 
factor clearly reflects the over-all impression the principal made on others 
who observed or worked with him on the problem. The factor reflects in 
large part the amount of participation of the principal in the group interac- 
tion situation. 

Factor G is a bipolar factor involving only the personality test scores. 
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It is easy to identify as Anxiety vs. Emotional Maturity. The following six 
personality factor scores have loadings of +.25 or higher on Factor G. 


VARIABLE LOADING 
Q,. Nervous Tension OZ 
O. Insecurity qi 
L. Suspicious pee 
H. Adventurous —.40 
Q,;. Will Control —.56 

Emotional Stability —.60 


This factor is clearly defined positively by nervous tension, anxiety, 
suspiciousness, shyness, lack of purpose, and lack of frustration tolerance, 
and negatively by emotional maturity, self-confidence, trustfulness, char- 
acter stability, and freedom from anxiety or nervous tension. It covers a 
large proportion of the usual indicators of personal adjustment. 

Since Factor H is clearly the same factor identified as Analyzing the 
Situation (Factor D) in the factor analysis of the in-basket test scoring cate- 
gories, the same name will be used for Factor H. The following variables 
have loadings of =.25 or larger on this factor. 


VARIABLE LOADING 


Conceptual Analysis .68 
Program Values .66 
Human Values 34 
Recognition of Good Work .30 
Uncontrolled Delegation —.25 
Number Facility 1 —.28 


The key to identification of this factor is, of course, the high loadings 
for Conceptual Analysis and Program Values. The two in-basket categories 
defined the in-basket performance Factor D. The categories Human Values 
and Recognition of Good Work were observed in previous discussion to 
be correlated positively with Factor D (Chapter 12). The negative loadings 
of Uncontrolled Delegation and Number Facility 1 (speed of manipulation 
of overlearned symbols) may be indicative of a set toward quickly disposing 
of matter seen as routine detail which is in opposition to a set toward broad 
situational analysis. 

Factor I is very similar to the in-basket factor identified before as Di- 
recting the Work of Others. The following variables have loadings of +.25 
or higher on Factor I. 


VARIABLE LOADING 


Leading Action af 
Courtesy to Subordinates .74 
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Directs “73 
Informs Subordinates 41 
Number of Words 34 
Sets Deadline 34 
Informality to Subordinates a4 
Courtesy to Outsiders 30 
In-basket Scorers’ Rating .28 


Although there are minor differences between this factor and its coun- 
terpart, Directing the Work of Others, found in the analysis of in-basket test 
performances, it will also be labeled Directing the Work of Others. The 
minor difference appears to be in the direction of emphasis on directing the 
work of subordinates. The three in-basket categories (Leading Action, 
Courtesy to Subordinates, and Directs) which were used in the computa- 
tion of the composite score for Factor H and included among the 120 
variables to represent the in-basket Factor H (Directing the Work of Oth- 
ers), clearly have the highest loadings on this factor. 

Factor J is defined by the six categories of job performance values that 
were used in scoring the principals’ responses to the problems presented by 
tape recordings. This factor has been entitled Job Performance Values. 
Loadings of +.25 or larger are as follows: 


VARIABLE LOADING 
Pupil Personnel 3 
Instruction and Curriculum oe 
Employee Personnel py. 
Public Relations 44 
Physical and Fiscal Organization .40 
Planning and Structure 35 


This is clearly a factor generated by the procedure used in obtaining the 
responses or the method used in scoring them, or both. 

Factor K is almost a residual factor but does have an interpretable set of 
very small loadings for categories from the in-basket test. These loadings 
are as follows: 


VARIABLE LOADING 
Terminal Action 30 
Concluding Decision we], 
Follows Subordinates 27. 
Total Background Achievement .26 
Controlled Delegation —.28 


This factor may be labeled to correspond with Factor C from the in- 
basket test analysis, since the three highest positive loadings are for the 
three categories that defined Complying with Suggestions Made by Others. 
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To indicate its near-residual character, the title Complying with Suggestions 
(Residual) has been selected. 

Factor L is defined entirely by the three scores that were obtained from 
the reports of the principals’ teachers. These loadings are as follows: 


VARIABLE LOADING 
Teachers’ Reaction .83 
Consideration A iii 
Initiating Structure 38 


This factor again may be generated by the procedure used in obtaining 
the data, i.e., asking teachers to fill in inventories concerned with their im- 
pressions of their principals. It has been labeled simply Teachers’ Impres- 
sions. 

Factor M is defined largely by data from biographical sources. It has 
been labeled Age and Experience because of the clear pattern of the load- 
ings for these items. 


VARIABLE LOADING 
Total Years in Professional Work 77 
Age .76 
Total Years in Administration .64 
Sex (Women) 1 
Psychologist —.25 
Total Years of Academic Preparation —.25 
Speed of Closure 2: Gestalt Completion —.38 


The small loadings on Psychologist, Years of Academic Preparation, and 
Sex are probably indicative of recent changes in the methods of selecting 
and preparing elementary school principals. Performance on the Gestalt 
Completion Test has been shown in previous research to decline sharply 
with age in adults.? 

Factor N is very similar to the second-order Factor X from the analysis 
of the in-basket category scores, and has been given the same title, Preparing 
for Decision vs. Taking Final Action. The following pattern of loadings is 
close to the saturation of these categories with Factor X (indicated to the 
right in parentheses). 


VARIABLE LOADING 
Discusses with Subordinates OGG oun 
Communicates Face to Face [61 Gaon 
Decides on Procedure 60 (.69) 
Immediate Work Scheduled 1) G6) 


* Harold Basowitz and Sheldon J. Korchin, “Age Differences in Perception of 
Closure,” Journal of Abnormal and Social Psychology, 54:93-97, 1957. 


APPENDIX E 403 


Intermediate Work Scheduled 37, 9" (4) 
Discusses with Superiors (or Outsiders) .36 (.26) 
Asks Subordinates Ome) 
Outsiders Involved 2) tel) 
Concluding Decision —.44 (—.52) 
Terminal Action —.66 (—.62) 


The appearance of the second-order factor from the analysis of in-basket 
test categories as a first-order factor in this 120-variable, objectively rotated 
analysis gives added support to the existence of such a factor. The emphasis 
that has been placed on Preparation for Decision as a central dimension of 
elementary school administration thus is supported. 

Factor O is defined by the 11 categories of instructional awareness used 
to describe the concerns expressed by the principals in preparing the pro- 
bationary reports and outlines of interviews after viewing the kinescopes. 
This factor has been labeled Instructional Awareness. The 12 variables have 
loadings on Factor O as follows: 


VARIABLE LOADING 
Interest .60 
Planning ey 
Curriculum lh 
Participation 49 
Methods 48 
Objectives 47 
Growth 41 
Evaluation .40 
Climate 38 
Classroom el 
Personality 28 
Pupil Education 2t, 


The twelfth variable, Pupil Education, is from the values expressed by 
the principals during their study of background material. This factor is 
generated at least in part by the procedure of gathering and scoring the 
kinescope data, but the appearance of the small loading for a variable ob- 
tained in a somewhat different manner suggests that the factor is more than 
just a test-form factor. 


INTERRELATIONSHIPS AMONG THE FIFTEEN FACTORS 
A THROUGH O 


The correlations among these 15 factors are perhaps of as much interest 
as their identification and interpretation. For the most part, the 15 factors 
were either noted in previously reported analyses or were associated with 
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specific techniques or procedures used in carrying out the study. The fac- 
tors were obtained by an oblique rotation method; their intercorrelations 
provide an over-all framework from which to view the entire study. An- 
swers to such questions as “What is the relationship between superiors’ and 
teachers’ impressions of the same principal?” or “Are age and experience 
important in determining whether a principal prefers to prepare for decision 
rather than take final action?” are contained in the intercorrelations of 
these factors. 

Table E-2 presents the intercorrelation among the 15 oblique factors 
which have been identified in this section. 

Examination of the correlations among the factors as reported in this 
table may begin with the two factors that reflect evaluations of the princi- 
pals in the local school situation. These are Factor B, Superiors’ Over-all 
Impression, and Factor L, Teachers’ Impressions; they are related by a small 
positive correlation of .11. 

Superiors’ impressions are positively related to Factor N, Preparation 
for Decision vs. Taking Final Action (r = .18), Factor J, Job Performance 
Values (r = .17) and Factor O, Instructional Awareness (r = .16). All the 
relationships are small. Apparently superiors’ impressions are created by 
variables other than those reflected in the correlations of Table E-2. One 
such variable of possibly great significance is the in-basket test factor, Ex- 
changing Information, which has been discussed. It would seem, however, 
that superiors’ ratings are questionable, to say the least, as criteria of the 
administrative performance of their principals. Their low general relation- 
ship with other evidence of quality of this performance can be viewed as 
an indication of the low basic relevance of such ratings, perhaps because of 
their superficiality. 

Teachers’ impressions apparently are influenced positively by the gre- 
garious friendliness of the principals (Factor D, r = .36) and the job per- 
formance values of the principals (Factor J, r = .20), and negatively by the 
principal’s exercise of independent initiative and his tendency toward analy- 
sis of the situation (Factor H, r = —.24). It appears that the principal who 
interacts freely and in a pleasant manner with his teachers, shows an interest 
and concern in their problems, and refrains from taking an independent an- 
alytical attitude toward administration is regarded favorably by them. 

General Ability to Reason and Understand (Factor A) is positively re- 
lated to all the factors that pertain to different parts of the principal’s total 
performance. These include Preparing for Decision vs. Taking Final Action 
(Factor N, r = .37), Instructional Awareness (Factor O, r = .26), Effec- 


tive Participation in Group Interaction (Factor F, r = .25), and Job Per- 
formance Values (Factor J, r = .19). The relationships of this general 
ability with Age and Experience tend to be negative (r = —.27); however, 


Age and Experience shows positive correlation with Factors J and O. It 
would appear that effective performance of the principal in a strictly ad- 
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ministrative role depends more on his general ability to reason and under- 
stand problems than on his experience, but that experience is required for 
effective work in the areas of the job that pertain to his supervision of edu- 
cational activities—a part of the total task of elementary school administra- 
tion that is valued by his superiors and by his teachers. 

The relationship between the variables on which the 15 factors are based 
and performance on the in-basket test problems has been examined in great 
detail in Chapter 13. The general relationship shown in Table E-2 between 
Factors E, H, I, K, and N, all involving in-basket test performance, and the 
other factors can add very little to that exhaustive analysis and will not be 
considered here except to observe that they are consistent with the earlier 
analyses. 


Appendix F 


AN ALTERNATE ROTATION OF SECOND-ORDER 
IN-BASKET TEST FACTORS 


A ROTATION OF TWO SECOND-ORDER FACTORS WAS REPORTED IN CHAPTER 7 
which identified the factors as Preparation for Decision vs. Taking Final 
Action (Factor X) and Amount of Work Expended in Handling Items (Fac- 
tor Y). In Chapter 13 the same rotations were involved in the special analy- 
sis of 120 variables from the study. 

In this appendix an alternate rotation of the second-order factors will 
be presented and discussed by comparing the results with those reported 
earlier. 


ROTATIONS 


The orthogonal transformation matrix employed to achieve the original 
rotation and an alternate (orthogonal) transformation matrix are presented 
in Table F-1. 

The two transformation matrices differ markedly in the amount of 
change from the unrotated position of the reference vector which they affect. 
As compared with the original rotation, the alternate rotation involves a 


TABLE F—1. Original and alternate second-order factor transformation 


matrix 
Original Transformation Alternate Transformation 
Cree xX. | Y, ACTOR AGM. | Yeas 
xX .8910 4540 x Die —.1714 
Y —.4540 .8910 ay; .1714 9852 
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TABLE F—2. Second-order factor loadings of eight primary factors 


Originally Alternately 
Primary Factor Unrotated Rotated Rotated 

x r¢ X, Y, Xa Ye 
Factor A .83 19 66 54 85 .03 
Factor B 719 —.Ol1 a7 Lene 3 4 77 —.15 
Factor C —.25 BD) —47  .38 —.15 59 
Factor D By, 2D) S/o es 0 35 19 
Factor E pes 59 —.05  .63 34 54 
Factor F 77 —.21 7 Sone LO 72 —.34 
Factor G —.53 3. —.63 .08 —.45 44 
Factor H 61 .20 46 3.45 .63 .09 


minor change in the position of the reference vectors. Table F—2 presents 
the loadings of the eight primary factors on the (1) unrotated, (2) origi- 
nally rotated, and (3) alternately rotated second-order factors. 

The saturations with the alternate second-order factors of each of the 
40 in-basket test scoring categories used in the analysis reported in Chapter 
7 were computed. These saturations, together with the corresponding satu- 
rations from the original rotation, are presented in Table F-3. 

Saturations of £.30 or greater are arranged in order of magnitude for 
Factor X,: 


Decides on Procedure 19 
Initiates Structure A (8) 
Subordinates Involved a if 
Usual Actions 70 
Asks Subordinates .69 
Number of Words .69 
Communicates Face to Face .68 
Requires Information .68 
Discusses with Subordinates .67 
Leading Action .64 
Directs .64 
Relates to Other Materials 61 
Immediate Work Scheduled 59 
Unusual Action 34 
Inform Subordinate 54 
Intermediate Work Scheduled Aas) 
Subordinate Group Involved 49 
Discusses with Superiors .48 
Courtesy to Subordinates 47 
Outsiders Involved .44 


Follows Structure 44 


TABLE F-3. Saturations of in-basket test scoring category scores with 
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second-order factors for original and alternate rotations 


OONIAMNAPWNR 


. Informality to Subordinates 24 


Second-order Factors 


Category ORIGINAL ROTATION ALTERNATE ROTATION 
Xo Yo Xa Ya 

. Number of Words 36 Lo .69 2 
. Items Omitted —.20 —.43 —.42 —.23 

Usual Actions 38 .66 .70 31 
. Subordinates Involved 47 pel ANP rly 
. Subordinate Groups Involved phe) 44 49 18 
. Superiors Involved .08 44 Bo .30 
. Outsiders Involved .10 .60 .44 42 
. Unusual Actions say 47 54 18 
. Aware of Poor Work 26 1 39 .09 
. Careless —.23 .04 —.16 AY; 
. Relates to Other Materials 45 41 61 .06 
. Conceptual Analysis .24 38 41 16 
. Program Values .08 29 24 19 
. Discusses with Subordinates .60 5 i .67 —.11 
. Discusses with Superiors 26 45 .48 .20 
. Asks Subordinates 6 42 .69 .00 
. Requires Information 63 28 .68 —.15 
. Delays shy —.26 —.04 —.30 
. Decides on Procedure .69 39 .79 —.10 
. Concluding Decision —.51 36 —.20 oY 
. Plans Only .16 —.08 .08 —.16 
. Immediate Work Scheduled 61 a. 59 —.23 
. Intermediate Work Scheduled 34 16 53 —.20 
. Indefinite Work Scheduled Ais) a | 28 3 
. Leading Action 41 pe) .64 18 
. Terminal Action —.62 4s) —.40 49 
. Follows Subordinates —.10 39 16 oY! 
. Follows Superiors .O9 eit 8 36 
. Follows Outsiders —.05 .48 Fa) .42 
. Follows Structure oe 30 .44 05 
. Initiates Structure 54 .49 13 .O7 
. Directs Shy seri .64 24 
. Communicates Face to Face So) .40 .68 —.01 
. Communicates by Telephone “ave eH; 42 02 
. Communicates by Writing .O7 by) aie) .40 
. Informs Subordinates 29 ee 54 24 
. Informs Outsiders —.04 47 pass £33) 
. Courtesy to Subordinates 38 PA | 47 —.01 
. Courtesy to Outsiders .03 36 24 21, 
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Communicates by Telephone 42 
Conceptual Analysis 41 
Communicates by Writing 39 
Aware of Poor Work 39 
Follows Superiors 38 
Informality to Subordinates ae 
Superiors Involved 33 
Terminal Action —.40 
Items Omitted —.42 


Thirty of the 40 scoring categories have notable saturations with this 
new Factor X,. The factor has a general resemblance to the original Factor 
X. Perhaps the most significant difference between the original and alter- 
nate Factor X is reflected in the change in saturation for the scoring cate- 
gory Concluding Decision. Originally this category had a —.51 saturation 
which shifted to a —.20. Also important in comparing the original and al- 
ternate rotations are the shifts involving the following categories: Usual 
Action (.38 to .70), Leading Action (.41 to .64), Initiates Structure (.54 
to .73) and Directs (.37 to .64). These changes reflect a greater emphasis on 
organizing for decisions and action. This suggests that the alternate Factor 
X may be labeled Organizing Preparatory Work vs. Treating Problems 
Summarily. 

The following in-basket categories had saturations of +.30 or greater 
with Factor Y,, in the alternate rotation. 


Concluding Decision 9 
Terminal Action .49 
Outsiders Involved 42 
Follows Outsiders 42 
Communicates by Writing .40 
Follows Subordinates net 
Follows Superiors 36 
Informs Outsiders oe 
Number of Words ep 
Usual Actions sey. 
Superiors Involved 30 
Delays —.30 


New Factor Y, does not resemble the original Factor Y,, which was 
clearly identified as Amount of Work. The new Factor Y, contains elements 
of both decisiveness and responsiveness. Decisions and responses are not 
delayed but are completed with work on the in-basket item. To some small 
degree this new second-order factor is similar to the negative pole of Fac- 
tor X,, the bipolar factor Preparation for Decision vs. Taking Final Action. 
Factor Y, might be called Responding with Prompt Decisions since both 
reaching a concluding decision and following the suggestions of others are 
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prominent, along with taking terminal action, in the categories that load 
high on the factor. Taking terminal action and following suggestions are 
possible on most of the items if, and only if, a decision is reached during the 
period of the in-basket test. 

It is important to note the distinctions between the frame of reference 
provided by the original and alternate rotations insofar as these distinctions 
are relevant for a theory of administrative performance. Some of the impli- 
cations of the original factors for theory are discussed in Chapter 12 (pages 
285 through 288). There it was suggested that administrative behavior 
might be viewed as requiring an expenditure of energy at various stages of a 
decision-action process, the stages of this process being linked with points 
on the bipolar continuum describing Preparation for Decision vs. Taking 
Final Action (X,). The alternate rotation provides a frame of reference for 
administrative theory that does not emphasize energy expenditure and that 
does not place preparation for decision in opposition to making decisions 
and taking action. It allows independence between activities that are asso- 
ciated with prompt decision making and activities that have preparation for 
decision as their purpose. It is clearly possible for an administrator to en- 
gage in a large amount of preparatory work and also to make a large number 
of prompt decisions. Both require energy and, if both are done at a high 
level, a very large expenditure would be entailed. The difference between 
the original and alternate interpretation of the second-order influence can be 
generally illustrated by a hypothetical example involving the following two 
ways of describing what is, in essence, the same thing: Mr. Brown’s admin- 
istrative performance (see Figure F—1). 

From the point of view of the original rotation, Mr. Brown is a very 
able and vigorous administrator, being high on both Factor X, and Factor 
Y,. He is described by such statements as: “Mr. Brown is a real producer. 
He puts out more work than almost anyone else. He is also very perceptive. 
He sees the full implication of a problem and prepares himself well before 
he makes a decision or takes a final action. By far the most significant em- 
phasis in his work is his effort to prepare himself for what he will do.” 

From the point of view of the alternate rotation, Mr. Brown would be 
described as follows: “Mr. Brown does an extremely large amount of or- 
ganizing for decisions. He sees each problem in its full complexity and then 
leaves nothing undone which could help him make better decisions. He does 
not find it possible in a limited time to reach other than the very minimum 
of concluding decisions or to take final action on problems.” Mr. Brown 
would be high on Factor X, but low on Factor Y,. Figure F—1 located Mr. 
Brown’s administrative performance within the second-order factor domain 
and shows its relationship to frames of reference provided by the original 
and alternative rotations. 

The important point to observe in comparing the original and alternate 
second-order rotations is that it is not necessary to choose one in preference 
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Postpone 


Delays 


Do Nothing 


Items 
Omitted 


Act /Summarily 


Xo Prepare 
Xa Organize 
Decides on Mr. Brown's 
Procedures Administrative 
: Performance 
Immediate 
Work Scheduled 
Initiates 
Structure 
Leading 
Action 
Words 
- 2/Formality eR 
to/Subordinates 
Plans Informs 


Subordinates 


Follows 
Superiors 


Yo Work 


Informs 
Outsiders 


Follows 
Subordinates 


Carejless 
Concluding 
Decision 
Terminal 
Action 
Ya Decide 
Act 


—— 


FIGURE F—1. Schematic comparison of Mr. Brown’s administrative perform- 
ance with original (X, and Y,) and alternate (X, and Y,) loca- 
tion of reference axes for second-order factor. 
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to the other. Both are equally correct and both may be found useful to the 
understanding of administrative performance. 

To complete this study of an alternate rotation of the second-order fac- 
tors, the computations of saturation of the variables included in the basic 
analysis in Chapter 13 were duplicated for Factor X, and Factor Y,. The 
results of these computations are presented in Table F—4 along with the 
saturations for the original rotations. These results provide a further insight 
into the relationship between basic abilities and administrative performance. 

One very clear general feature of Table F—4 is the large number of high 
relationships between Factor X, and other variables. The relationships are 
particularly notable for tests of professional and general knowledge, basic 
mental abilities, categories of instructional awareness, and several of the 
performance evaluations. Principals who tend to Organize Preparatory 
Work rather than Treat (in-basket) Problems Summarily are more highly 
evaluated by their superiors, the in-basket test scorers, and the research staff. 
These principals have superior professional knowledge, generally have 
greater basic mental ability, and tend to display concerns about educational 
objectives, methods, and the like. The personality factors do not relate to 
Factor X,. In comparing the relationship between knowledge and ability 
variations for Factor X, with those for Factor X,, it is noteworthy that most 
of the coefficients are generally larger. 

Very little additional insight about Factor Y, is obtained from the data 
in Table F—4. None of the non-in-basket test variables show meaningful re- 
lationships with Factor Y, which appears to be relatively specific to in-basket 
test performance. 


SUMMARY 


An alternate rotation of two second-order in-basket test factors has been 
presented and discussed. The resulting alternate factors were identified as 
X,, Organizing Preparatory Work vs. Treating Problems Summarily and Y,, 
Responding with Prompt Decisions. These factors were compared with those 
resulting from the original rotation: X,, Preparation for Decision vs. Taking 
Final Action, and Y,, Amount of Work Expended in Handling the Item. 
Both of the two rotations provide meaningful descriptions of administrative 
performances and it is not necessary to choose one in preference to the 
other. The reason for treating the original rotation as the basis for the analy- 
ses reported in Chapters 7 and 13 is that the authors were particularly con- 
cerned with amount of work as a possible artificial variable introduced in 
the study by the research methodology which perhaps placed an unnatural 
emphasis on written production. The original rotation treats amount of 
work as a separate variable and makes it possible to see its influence inde- 
pendently of other findings of the study. 


TABLE F-4. 


Variable 


In-basket Scoring Category 


Asks Subordinates 

Informs Subordinates 
Discusses with Subordinates 
Communicates Face to Face 
Decides on Procedure 
Concluding Decision 
Follows Subordinates 
Terminal Action 

Program Values 
Conceptual Analysis 
Superiors Involved 
Discusses with Superiors 
Outsiders Involved 

Relates to Other Materials 
Immediate Work Scheduled 
Intermediate Work Scheduled 
Informs Outsiders 

Follows Outsiders 

Courtesy to Outsiders 
Leading Action 

Courtesy to Subordinates 
Directs 

Careless 

Delays 

Informality to Subordinates 
Number of Words 


Basic Mental A bilities 


Deduction 

Speed of Closure 1 
Number Facility 1 
Verbal Knowledge 
Induction 

Associative Memory 1 
Number Facility 2 
Flexibility of Closure 
General Reasoning 
Visualization 

Speed of Closure 2 
Word Fluency 
Expressional Fluency 
Ideational Fluency 
Associational Fluency 
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Loadings of 120 variables (from Chapter 13 analysis) 
on estimated second-order factors 


Estimated Second-order Factor 


Yo 


Xa 


Ya 


TABLE F—4, Continued 


Variable 


Estimated Second-order Factor 


Professional and General Knowledge 


School Administration and 
Supervision 

Education in the Elementary School 

NTE Social Studies 

NTE Science and Mathematics 


Background Achievement 
Total Score 


Basic Personality Factors 

Friendly 

Emotional Stability 

Dominance 

Enthusiastic 

Character Strength 

Adventurous 

Emotionally Sensitive 

Suspicious 

. Nonconventional 
Sophistication 
Insecurity 

. Self-sufficiency 

3. Will Control 

4. Nervous Tension 


Zar cLOmmnoO > 


LLCO 


Background Orientation Categories 
Pupil Education 
Community Concerns 


Strong Vocational Interest Blank for Men 


Psychologist 

Policeman 

Public Administration 

City School Superintendent 
Lawyer 


Categories of Instructional Awareness 
Objectives 
Evaluation 
Planning 
Curriculum 
Participation 
Interest 
Growth 
Methods 
Personality 


—.07 


—.17 
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TABLE F—4, Continued 


Estimated Second-order Factor 


Variable X, 
Classroom Lg 
Climate ays 
Categories of Job Performance Values 
Instruction Ak) 
Pupils .04 
Employees lis 
Physical —.13 
Structure 29 
Public .02 
Group Interaction Categories 
Frequency of Interaction 20 
Gives Positive Information si) 
Asks for Information 10 
Suggests New Procedures 3 
Presents Facts Effectively Jim) 
Makes Decisions Effectively 3 
Amount of Talking Jail 
Attempts to Influence .09 
Biographical Information 
Total Years in Professional Work O1 
Total Years in Administration —.07 
Total Years of Academic Preparation .14 
Age —.05 
Sex (Men = 1, Women = 2) a3 
Superiors’ Ratings 
Interest in Work* 6M 
Sticking to a Job pa) 
Getting Along with Teachers* 18 
Getting Along with Parents* nila) 
Getting Along with Superiors* 14 
Knowledge of Administration yn) 
Knowledge of Teaching* 339 
Rapport with Children Jie) 
Written Communication .20 
Understanding* oly! 
Oral Communication (Informal) ) 
Over-all Impression* ok 
Teachers’ Questionnaire Scores 
Consideration —.01 
Initiating Structure pial 
Teachers’ Reaction 13 


416 


Yo 


Xa 


«19 
25 


Ya 


TABLE F—4, Continued 


Estimated Second-order Factor 


Variable X, Wes X, Ye 
Staff Members’ Ratings 
Staff Rating iD .20 oe .O1 
In-basket Scorers’ Ratings 
Scorers’ Rating 41 oe) .66 .20 


* Sign changed in order that a high loading will correspond with a favorable 
rating. 
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Ability to Get Along with Parents [CATE- 
BOR Vim Oleni2 17, 220; .220:1,, 231 f., 
2301206020), 297, 323,392, 39/7; 416 

Ability to Get Along with Superiors 
[GATEGORY.,..161, .217,. 226, 228 f., 
Daten 30.235, 265, 298, 323, 392, 
397, 416 

Ability to Get Along with Teachers 
[CATEGORY], 161, 217, 226, 228 f., 
Pott O35, 20), 297, 323; 392, 
397, 416 

Academic Preparation [CATEGORY], 187, 
ae a6). 299, 320," 392, 402, 
416 

Achievement of students in simulated 
school, 35 

Addition Test, 78 f. 

Adjective-pairs (see Scorers’ In-basket 
Rating) 

Administration, behavior in, framework 
for understanding, 285 ff.; control in, 
345; decision making, theory of, 6; 
experience of participants, 67 f.; im- 
plications of study for, 330 ff.; per- 
formance components, 290 ff.; prac- 
tice of, 345; preparation of tasks in, 
46 ff., 59 f.; problem solving, theory 
of, 6; teaching of, materials for, 8 

Administrative Experience [CATEGORY], 
tS jee 1240.4 20), 299, 320, 392, 
402, 416 

Administrators, history of literature on, 
2 f.; implications of study and, 331 ff. 

Administrators, preparation of, 340 ff.; 
content and methodology, 341 ff.; 
programs, 340 f. 


Advanced Vocabulary Test, 75, 79 

Adventurous vs. Shy [Factor], 81, 84, 
[Reyes RR) DAR oe phd pay PAST Nhe au 
390, 398, 400, 415 

Advisory Committees, 385 ff. 

Age and Experience [FACTOR], 402, 404 f. 
Age [CATEGORY], 187, 215, 240, 264, 
276, 299, 320, 326, 392, 402, 416 

Ages of participants, 65 

Agreement with Suggestions 
Gory], 197 

Amount of Talking [CATEGORY], 156, 
TS iago pltees bom 22 Ole 97620, 
326, 391, 399, 416 

Amount of Work Expended in Han- 
dling the Item [FAcToR], 146, 285 ff., 
201s LOT eS 22 urs 26 2828559, 3.00, 
407, 410, 413 

Analyzing the Situation [COMPOSITE], 
Diy, PA, PIES. PAO SIRES BY Be, 
392 

Analyzing the Situation [FACTOR], 142, 
305se 3 085s 13 ts Sis 2.1,035.2.4.8328) 
400, 404 

Anxiety, handling of, 18 . 

Anxiety vs. Emotional Maturity [FAC- 
TOR], 400, 404 

Anxious Insecurity vs. Placid Self-con- 
fidence [FACTOR], 82, 84, 154, 185, 
39804 5.0 203.029 6.012, 220,590, 
400, 415 | 

Appropriateness of actions, 90 

Arrangements, local administrative, 14 f. 

Arrangements, test week, 12 ff. 

Arrives at a Procedure for Deciding 
[CATEGORY], 97, 101, 108 f., 126, 132, 


[CATE- 
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13699135) 0140, 01455001 Joe One LOS 
246, 257, 288, 294, 301, 306, 388, 
402, 408 f., 414 

Arts, fine (see Social Studies, Litera- 
ture, and Fine Arts test) 

Asks for Information [CATEGORY], 156, 
1875919255197 1.72007 215.7250" 2615 
297, 320, 391, 416 

Asks for Information, Opinion, Advice 
or Permission from Outsiders [CATE- 
GORY] 71 01,81089)126.5259502/5,02/8, 
280 

Asks for Information, Opinion, Advice 
or Permission from Subordinates 
[CATEGORY], 97, 101, 108, 126, 132, 
135 f., 140, 145, 155, 182, 210, 246, 
257, 288, 294, 301, 306, 388, 403, 
408 f., 414 

Asks for Information, Opinion, Advice 
or Permission from Superiors [CATE- 
GorY], 101, 108, 126, 259, 278, 280 

Associational Fluency [FAcTorR], 76, 79, 
PSU 9e1 84.82 12 462 a Oe 
219,28 1 fe 284252950309 993 20,0359, 
396, 414 

Associative Memory [Factor], 78 f., 
DD yn OA? 1 2agt ao ae 70.19 ees 9) 
389, 414 

Attempted Group Domination [FACTOR], 
200 

Attempts a Final Decision [CATEGORY], 
1933197 

Attempts to Improve the Working Con- 
ditions of the Staff [CATEGORY], 102, 
Lion 

Attempts to Influence [CATEGORY], 156, 
18752197 fhe 215,290,226 17) 284.0297; 
320, 391, 399, 416 

Aware of Poor Work (see Shows Aware- 
ness of Poor Work) 


Background achievement, 21, 396, 401; 
correlations, 213, 262f., 296, 298; 
estimated factors and, 308 ff.; load- 
ings, 415; sex differences, 390 

Background materials for simulated 
school, 41 ff. 

Background of participants, 64 ff. 

Background orientation, estimated fac- 
tors and, 311 ff.; loadings, 415; sex 
differences, 390 

Backs Up Teachers or Staff Officers 
[CATEGORY], 102, 115, 127, 259, 278 

Barnard, Chester, 6 


Behavior, administrative, framework 
for understanding, 285 ff.; concepts, 
lack of, 4; emphasis on, 3; interper- 
sonal, assessment of, 59; spontaneity 
in, 56 

Behavior, problems in study of, 3 ff.; 
operational, 4f.; situational differ- 
ences, 5 

Benson, Arthur, ix 

Bertoti, 336 

Bibliography, -361 ff. 

Biographical information, correlations, 
187, 215, 239 f., 264 f2299-sreste 
mated factors and, 319 ff., 326, 329; 
loadings, 416; sex differences, 392 

Biquartimin criterion, 394 

Board of Education of simulated town- 
ship, 31 

Board Statement of Policies and By- 
laws, 21, 44 f. 

Bretsch, Howard, ix 

Brown, Lois, ix 

Bulletin to Parents, 53 


Capacity to Stick to a Job in Spite of 
Difficulty [CATEGORY], 161, 217, 226, 
228 £., 231 f,°°236,23 55ee7 Oe ee 
274, 297, 323, 392, 397, 416 

Carelessness or Minor Error [CATE- 
GorY], 100, 105, 126, 132, 136, 140, 
143, 155, 182, 211, 246.5 294.030% 
306, 389, 397, 409, 414 

Carlton, Sydell, v 

Cattell, Raymond B., 85, 128, 357 

Cedar Park, description of, 29 

Centralization in simulated community, 
33 

Character stability, 81 

Character Strength vs. Lack of Con- 
ventional Standards [FAcTorR], 81, 
83 f., 154, 160, 185,:213 5 24555262— 
296, 312, 390, 398, 415 

Child Growth and Development [CATE- 
GoRY], 157, 167, 16958)/7 i pene 
186, 214, 252, 260; 269277 tees 
297,317,391 84035415 

Clarity and Impressiveness [CATEGORY], 
203 ff—., 261, 270, 273,52/9se25 ee 
393 

Classroom, Climate-Routine  [CATE- 
Gory], 157, 168 f., 17] foe v4eeioes 
214, 252, 260, 273, 297-3 ee 
403, 416 

See also Physical Setting-Classroom 


Classroom, self-contained, in simulated 
school, 33 

Climate (see Classroom) 

Closure tests (see Flexibility of Closure; 
Speed of Closure) 

Coffield, William, v 

Cold-hearted—Genial [CATEGORY], 161, 
2244236, 263 

Collection of data, 9, 12 ff. 

Committee for Selection of School 
Board Nominees in simulated com- 
munity, 31 

Committee for the Advancement of 
School Administration, viii 

Committees, Advisory, 385 ff. 

Communicates by Telephone [CATE- 
GOR ieetO2-0113, 127, 132;(137, 141 
ff., 409 

Communicates by Writing [CATEGORY], 
are ite 27, 132,0137,°139, 141, 
143, 145, 275, 409 f. 

Communicates Face to Face [CATE- 
GORY fer 1 3.122127; 132,137 f., 
Wate al), 118257210, 246, 257, 
294, 301, 306, 388, 399, 402, 408 ff., 
414 

Community [CATEGORY], 262, 271, 273, 
Dil 9281, 284 

Community Concerns [CATEGORY], 263, 
296, 312, 390, 415 

Community Dynamics [CATEGORY], 263 

Community Institute of simulated com- 
munity, 32 

Community Institutions [CATEGORY], 263 

Community, Jefferson, 28 ff. 

Community relationships, conceptual 
problems, 54; human problems, 53 f.; 
technical problems, 53 f. 

Compliance, passive, 275 

Complying with Suggestions Made by 
Others [COMPOSITE], 257 ff., 268, 275 
tee 66s 355 335, 342 1.7357, 392, 
398, 401 

Complying with Suggestions Made by 
Others [FACTOR], 139, 160, 308, 313, 
Blows 324, 328 

Complying with Suggestions (Residual) 
[FACTOR], 401 f., 404 

Components distinguished from com- 
posite scores, 290, 325 ff. 

Composite scores, 256 ff., 269 ff.; sex 
differences, 393; unique components 
distinguished from, 290, 325 ff. 

Computational methods, advances in, 7 

Concealed Figures Test, 75, 79 
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Concepts, behavioral, lack of, 4 

Conceptual Analysis [CATEGORY], 97, 
100751067 712677 13225136) 14050142, 
DS Sel O2e 1 Ore 24678 20) 88s 204" 
301, 306, 388, 400, 409 f., 414 

Conceptual framework, 5 ff. 

Conceptual problems, community rela- 
tionships, 54; educational program, 
51; funds and facilities maintenance, 
54 f.; personnel development, 53 

Conceptual skill, 47 

Concern for Educational Program [FACc- 
TOR], 170, 174 

Concern for Human Problems vs. Con- 
ventionality [FACTOR], 397 f., 404 

Concern for Physical Aspects of In- 
struction [FACTOR], 173 f. 

Concern for Pupil Reactions [FACTOR], 
Lisi. 

Concern for Teacher Behavior [FACTOR], 
173 f. 

Concluding Decision [CATEGORY], 97, 
LOT 09 126.5 13213.6,.9138. 140, 
DAS eld 8252 10.46, 288 
294, 301, 306, 388, 399, 401, 403, 
409 f., 414 

Conclusion (see Effectiveness of Con- 
clusion) 

Consideration [CATEGORY], 158, 188, 
217, 234, 238, 240, 242, 244 ff., 250, 
Dd2 620) 29S So Zoo 92402, 416 

Consideration, characteristics of, 253 f. 

Consistency of performance, 124 ff. 

Consultants in simulated school, 33 

Contingent Decision [CATEGORY], 101, 
109; 126, 259 

Control in administration, 345 

Controlled Delegation (see Delegates 
Partially with Control) 

Cooperative Research Branch of United 
States Office of Education, iv, vii, viii 

Coordination [CATEGORY], 101, 111, 
127, 259, 280, 283 

Courses of action, samples of, 117 ff. 

Courtesy to Outsiders [CATEGORY], 102, 
PiSiel 2 (eso 37 4 el 43 55, 
1S 2) 1024652782 294 Ol) 
306, 388, 401, 409, 414 

Courtesy to Subordinates [CATEGORY], 
TOMS TAR 22027 S213 7 el 41; 
143951555 9182,02 1082465025759 294, 
301, 306, 388, 401, 408 f., 414 

Courtesy to Superiors [CATEGORY], 102, 
LSS WATS ae PAE) 


422 INDEX 

Courteous—Rude [CATEGORY], 161, 221 f., 
236, 263, 283 f. 

Criteria, biquartimin, 394; for future 
research, 354 ff.; oblimin, 394; per- 
formance, lack of, 4 

Cronbach, Lee J., 291 

Gubberiy, Bab 2 

Curriculum [CATEGORY], 157, 167, 169, 
Lilith (4018 68e2 (4252526088269; 
272 21 TALAe28 2,629 toed dod 914033 
415 

Curriculum in. simulated school, 33 f. 

Currie, Fergus, ix 


Daily Record, 21, 29 

Damarin, Fred, ix 

Data, collection of, 9, 12 ff. 

Davies, Daniel R., vii, 47 

Davis, John, ix 

Dean, Douglas, v 

Decides on Procedures (see Arrives at 
a Procedure for Deciding) 

Decision making, theory of, 6 

Deduction [FACTOR], 74, 79, 151, 160, 
184212 4a 6 le ed ine 
284, 295, 309, 389, 396, 414 

Delays or Postpones Decision, or Tem- 
porizes [CATEGORY], 101, 108, 126, 
1S2 136 L401 a2 wel ole 21, 
QAP 288 e205 te Ole SUG 3 O93 99, 
409 f., 414 

Delegates Completely [CATEGORY], 101, 
1h PA ned WAN fo PALE SE 

Delegates Partially but without Control 
[CATEGORY | VL Ol Si 272, 
DU 2AT plo 2 oe OUIEM Oa ao. 
B99 

Delegates Partially with Control [CATE- 
GORY] 1OLPe i212 el Loe: 
2118247 9259529530747 89, 
401 

Directing the Work of Others [com- 
POSITE], 257 ff., 268, 283 ff., 286 f., 
335, 342, 345, 350, 392, 400f., 404 

Directing the Work of Others [FACTOR], 
144 COR Osis 15 8 a3 2 es 2: 
328 

Directs (see Gives Directions and/or 
Suggestions ) 

Discusses with Other Principals [CATE- 
GorY], 101, 107, 126, 259 

Discusses with Subordinates [CATEGORY], 
9779100) 74073012 6901329138651 38;) 
AO LAST LDS dS 2502 Ore 46g 7; 


288, 294, 301, 306, 388, 402, 408 f., 
414 

Discusses with Superiors or Outsiders 
[CATEGORY], 101, 107f., 126, 132, 
136, 138, 140, 142) 0153 iSZee2 
246, 257, 294, 301, 306, 388, 398, 
403, 408 f., 414 

Discussing with Others before Acting 
[COMPOSITE], 257 ff., 268, 271 ff., 
280, 286, 342, 345, 392 

Discussing with Others before Acting 
[FACTOR], 139, 305, 308, 316, 319, 
32275325328 

Disregard for Conventions vs. Practi- 
cal Concernedness [FACTOR], 82, 84, 
154, 185, 213, 245, 263.5270 2ou 
312, 390, 397, 415 

Disturbing Interruption 
193, 197 

Dominance vs. Submission [FACTOR], 
81, 84, 154, 185,213) 2455262029 s 
312, 390, 398, 415 

Donald, Eleanor, v 

Dwyer, P.S., 302 

Dynamic Politics [CATEGORY], 264 


[CATEGORY], 


Ebel, Robert, ix 

Education in the Elementary School 
Test, 17, 70 £., (151184782 es 
262, 270, 273; 275,02 17 ee 
282, 284, 298, 309f., 338, 341, 389, 
396, 398, 415 

Educational goals and social class, 67 

Educational Interest Inventory, 17, 70 

Educational level, of participants, 67 f.; 
father’s level, 66 

Educational level of simulated commu- 
nity, 28 

Educational policies in simulated com- 
munity, 33 ff. 

Educational Program [CATEGORY], 262, 
231; 273,216, 219 525i oe 

Educational Program [FACTOR] (see 
Concern for Educational Program) 

Educational Program, conceptual prob- 
lems, 51; human problems, 51; tech- 
nical problems, 49 f. 

Educational Testing Service, vii f. 

Effective Participation in Group Inter- 
action [FACTOR], 399, 404 f. 

Effective Use of Time [FACTOR], 207 

Effectiveness in Making Decisions [CAT- 
EGORY], 197, 200 


Effectiveness in Presenting Facts [CATE- 
GORY], 197 

Effectiveness of Conclusion [CATEGORY], 
ZOsiiee2o 1s. 270, 273,280, 393 

Effectiveness of Introduction [CATE- 
Gone eee ot, 201, 270,273 275, 
279, 280, 284, 392 

Efficiency (see Interest and Efficiency) 

Emerich, Mary, ix 

Emotional Stability vs. Lack of Frus- 
tration Tolerance [FACTOR], 80 f., 84, 
iametooo2 13, 245; 262,. 295, 312, 
326, 390, 400, 415 

Emotionally Sensitive vs. Tough Prac- 
ticality [FACTOR], 81 f., 84, 154, 185, 
mange). 263, 2/0, 296,312, 390, 
397, 415 

Empiricism, 6 f. 

Employed Personnel [CATEGORY], 157, 
P/S8itsels6, 214, 252, 260, 269, 273, 
C1550, 252,)297, 317,391, 401, 
416 

Enthusiastic vs. Sober [FACTOR], 81, 84, 
Tago .ee 13. 245,)°262;"295, 3.12, 
390, 398, 415 

Estimated Number of Words [CATE- 
GORY], 98, 100, 126, 132, 136, 139 f., 
Taye oa re sone 2 tt 247) 267-55) 295; 
301, 307, 389, 399, 401, 408 ff., 414 

Ethnic factors in simulated community, 
28, 36 

Evaluation [CATEGORY], 157, 167, 169, 
tet 429180, 214, 252; 260, 269, 
284, 296, 317, 391, 403, 415 

Evaluation, practical uses of, 348 

See also Performance, subjective 
evaluation 

Examination Booklets, 19 f. 

Exchanging Information [COMPOSITE], 
Pei ecose 209 ft., 286 f., 333, 339, 
B429545,0350, 392 

Exchanging Information [FACTOR], 138, 
305, 308, 311, 319, 322, 328, 405 

Experience, implications of study, 334 

Experience of participants, 67 f.; char- 
acteristics, 64 

Experimental Edition of Excerpts from 
the School Code of Lafayette, ix, 
44 f. 

Explains Actions to Outsiders [CATE- 
GoRY], 102, 114, 127, 259, 278 

Explains Actions to Subordinates [CAT- 
EGORY], 102, 114, 127, 259, 276, 283 

Explains Actions to Superiors [CATE- 
Conv) 102; 114,°127, 259, 278 
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Expressional Fluency [FACTorR], 76 f., 
Doel Sas S42) 22 2 ae 1 0. 
273, 295, 309, 389, 396, 414 


Facilities maintenance, conceptual prob- 
lems, 54f.; human problems, 54; 
technical problems, 54 

Factor analysis, 134f., 292 ff.; choice 
of method, 127 ff.; factors, estimated, 
305 ff.; first-order, 135; group inter- 
action, 196ff.; instructional aware- 
ness, 170 ff.; loadings, estimated, 304 
f.; second-order, 144 f.; second-order 
rotation, 407; speech, 205 ff.; unique 
components in, 290 ff. 

Faculty of simulated school, 30, 36f., 
43 f.; interactions of, 26f., 37 f.; se- 
lection of, 33 

Feedback, absence of, 9 

Filmstrip, 19; as background material 
for simulated community, 41 

First Names Test, 78 f. 

Fiscal policies in simulated school, 34 

Flexibility of Closure [FAcTor], 75, 79, 
BD1S61S4 ee) 1242 620 271082733 
279, 282, 295, 309, 389, 396, 414 

Florida Leadership Project, 333 

Fluency factors (see specific types) 

Fogarty, Honorable John E., viii 

Follows a  Pre-established Structure 
[CATEGORY (97 se LOL Ll 2658132, 
137, 139, 141 f., 408 f. 

Follows Lead by Outsiders [CATEGORY], 
OF LOL eh 26 1521372) 14 laft., 
SBR EAL PAU atin on pao eT AES 
409 f., 414 

Follows Lead by Subordinates [CATE- 
Gory], 97, 101, 110f., 126, 132, 136, 
DSN Teel A ees Sent 82 422106 246,025 7% 
288, 294, 301, 306, 388, 399, 401, 
409 f., 414 

Follows Lead by Superiors [CATEGORY], 
OR OLOL UL Let Ons 2s rA Ls 
145, 210, 246, 288, 294, 306, 388, 
409 f. 

Forceful—Tentative [CATEGORY], 161, 
Dalat. el 362 O38 mee 1 ed 427 05629: 
2812831, 

Four-Letter Words Test, 75 f., 79 

Frederiksen, Norman, v, vii, ix 

French, John, 74 

French, taught in simulated schools, 32 

Frequency of Interaction [CATEGORY], 
156518719 Lieto 00 2260829 7- 
320, 391, 399, 416 
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Friendliness [CATEGORY], 156, 197 ff., 
250, 261 

Friendly vs. Aloof [FACToR], 80, 84, 
TSAR LSS 2 34 ee om ly 
390, 398, 415 

Funds and Budgets [CATEGORY], 264 

Funds and Facilities [CATEGORY], 262, 
D7O,e2 19528 L284 

Funds, maintenance, conceptual prob- 
lems, 54f.; human problems, 54; 


technical problems, 54 


Gallagher, Henrietta, ix 

Garber, Lee, 1x 

General Ability to Reason and Under- 
stand [FACToR], 396f., 404 f. 

General knowledge (see Professional 
and general knowledge) 

General Reasoning [FACTOR], 74 f., 79, 
P10 O01 O42 1242 lee; 
273302751279 28 lhe, 2993930957389) 
396, 414 

Geographic locations of participants, 
12, 64, 380 ff.; of test centers, 13, 16 

Gestalt Completion Test, 75 f., 79, 402 

Getting Along with Parents, Superiors, 
Teachers (see Ability to Get Along 
with Parents, Superiors, and Teach- 
ers) 

Gibson, Oliver, ix 

Gifted children in simulated school, 34 

Gives Directions and/or Suggestions 
[CATEGORY], 97, 101, 113, 127, 132, 
13 713951415 14559145591 5), aoe, 
210, +246, 9257, 294, 301,306, 389; 
401, 408 f., 414 

Gives Information Not Related [CATE- 
GorRY], 192, 197 

Gives Information to Outsiders [CATE- 
GORY1,597, (LO2Mi 458 127 a 32 es 5: 
13 7em 14a 43 el 557 82 107246, 
Pai PRB) OBE. AUN, STU Bite heheh 
409 f., 414 

Gives Information to Subordinates [CAT- 
EGORY], 97, 102, 114, 127, 132, 135, 
1375189514 191455 1559918252 104246, 
257, 294, 301, 306, 388, 401, 408 f., 
414 

Gives Information to Superiors [CATE- 
GorY], 97, 102, 114, 127, 259, 278 

Gives Negative Information or Opin- 
ions [CATEGORY], 192, 197 

Gives Positive Information [CATEGORY], 
1565718710191 51197:9.,4200,' 21555250) 
260, 297, 320, 326, 391, 399, 416 


Gives Recognition for Ability or Good 
Work [CATEGORY], 100, 104, 126, 155, 
182, 211; 247, 259, 2692722 
278, 283, 295, 307, 389, 400 

Government, local, in simulated com- 
munity, 28 

Gregarious Friendliness vs. Independ- 
ent Initiative [FACTOR], 398, 404 

Griffiths, Daniel E., v, vii, ix, 46, 87, 
224 

Group interaction, 10, 24, 189 ff.; col- 
lection of data, 191 ff.; consistency 
of performance, 195 f.; correlations, 
156, 187, 215, 249 £5260 258297 eee 
timated factors and, 319 ff., 326, 329; 
factor analysis, 196 ff.; loadings, 416; 
sex differences, 391; simulated school 
faculty, 37 f. 

See also Speech 

Group interaction tasks, content of, 190 
f.; development of, 61 

Group Report Form, 195 f., 399; prep- 
aration of, 61 

Growth (see Child Growth and Devel- 
opment) 


Hallstead, Robert, v 

Halpin, Andrew, ix 

Handbooks, as background materials, 
44 f.; Jefferson Staff, 21, 33, 44 f. 

Handicapped children in _ simulated 
school, 34 

Hearn, Gordon, 349 

Hemphill, John K.., v, vii, ix, 87 

Hines, Vynce, ix 

History, literature on principalships, 2 f. 

Holloway, George, v 

Homans, George C., 43 

Howsam, Robert, ix 

Human problems, community relation- 
ships, 53 f.; educational program, 51; 
funds and facilities maintenance, 54; 
personnel development, 52 

Human skill, 47 

Human Values (see Uses Human or 
Personal Values in Analysis) 


Iannaccone, Laurence, v, ix 

Ideational Fluency [FAcTror], 77, 79, 
151; 184, 212, 242, 2625527008 27ae 
277, 279, 281, 284, 295, 309, 389, 
396, 414 

Imaginative score, 148 ff. 

Imaginativeness, 10; of courses of ac- 
tion, 91 


Immediate Work Scheduled (see Work 
Scheduled for Same or Following 
Day) 

Imposes Controls: Follow-up or Feed- 
back Planned [CATEGORY], 102, 115 f., 
121259, 283 

Imposes Controls: Sets a Deadline [caT- 
meen O26 1 1556127),155.'182,5211, 
Zaie2o9. 280, 283, 294; 307, 389, 
401 

Improves Staff [CATEGORY], 102, 115, 
Pa 

In-basket tests, Bureau of Business, 25; 
performance contrasted with school 
in-basket tests, 116 f. 

In-basket tests, communalities, 301; 
content, 10; December 4th, introduc- 
tion to, 58; definition of, 8; descrip- 
tion of items in, 49 ff.; estimated 
factors, 305 ff.; February 10th, intro- 
duction to, 58 f.; instructions for tak- 
ing, 56ff.; Labor Day, introduction 
to, 56 ff.; loadings, 306 f., 414; pro- 
gram for, 22; realism of, 55f.; sex 
differences, 338 f. 

In-basket tests, correlations (see Scor- 
ing in-basket tests) 

In-basket tests, development of, 46 ff.; 
analysis of job, 46 ff.; identification 
of problems, 48; incidents based on 
problems, 48; items from incidents, 
48 f.; paradigm showing, 50 

In-basket tests, scoring (see Scorers; 
Scores; Scoring) 

Incident, definition of, 48 

Indefinite Work Scheduled (see Work 
Scheduled: Indefinite Time or No 
Time Specified) 

Independent Self-sufficiency vs. Lack of 
Resolution [FACTOR], 82, 84, 154, 185, 
Bane 4 263, 296, 7312; 390, 3398, 
415 

Induction [FACToR], 74, 79, 151, 184, 
eal 61, 270, 273, 279,281 £., 
284, 295, 309, 326, 389, 396, 414 

Informality to Outsiders [CATEGORY], 
1O2e 50127, 259 

Informality to Subordinates [CATEGORY], 
i yomeinem i132, 137,139, 141, 
1p) 4s2, 210; 246, 294, 301, 306, 
388, 401, 409 f., 414 

Informality to Superiors [CATEGORY], 
LO? etl; 1275259 

Informs Outsiders (see Gives Informa- 
tion to Outsiders) 
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Informs Subordinates (see Gives In- 
formation to Subordinates) 

Initiates a New Structure [CATEGORY], 
Dijon Ole il. 122681 27 1 3 eal 
141, 145, 408 ff. 

Initiating Structure [CATEGORY], 158, 
1887207 .9234,°238, 240, 2428244 fF; 
29 OMe) 252 O35 9893238 39288 98, 
402, 416 

Initiating Structure, characteristics for, 
254 

Instruction and Curriculum [CATEGORY], 
US Jools 8 tie 18 6592149252292 60.9269, 
Pa OR, ORAS OL Pa OATES BBL EVR 
401, 416 

Instructional awareness, 347; correla- 
HONS 156 (eel S2 i425 let 200, 
296 f.; estimated factors and, 316 ff., 
326; factor, 403 ff.; frequency of re- 
sponses, 173 ff.; loadings, 415 f.; reli- 
ability, 169f.; scoring, 166 ff.; sex 
differences, 391 

Interaction Record, 194, 196 

Interest and Efficiency [CATEGORY], 203 
The261592.9 0527139215217 22802393 

Interest in Work [CATEGORY], 161, 217, 
DLOvm 2 oem) late ut2 307092 35,0 20), 
Di ged 4 e297 O32 5.63 90039 1224.16 

Interest (See also Motivation-Pupil In- 
terest; Vocational interests) 

Intermediate Work Scheduled (see Work 
Scheduled for Same or Following 
Week) 

Internal School Program factor, 181 

Introduction (see Effectiveness of In- 
troduction ) 

Involvement with Others in In-basket 
Work [Factor], 398 f., 404 

Items, definition of, 48 

Items Omitted (see Number of Items 
Not Attempted) 


Jefferson community, 28 

Jefferson School-Community Survey, 42 

Jefferson Staff Handbook, 21, 33, 44 f. 

Jefferson Township, description of, 28 f.; 
school district of, 30ff.; Teachers 
Association, 32 

Jefferson Village, description of, 29 

Job analysis for in-basket tests, 46 ff. 

Job content, 345 ff. 

Job performance values, 177 ff., 347; 
correlations, 156f., 182 ff., 214, 251 
f., 260, 297; estimated factors and, 
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316ff., 326, 328; evaluating re- 
sponses, 177 ff.; factor, 401, 414 f.; 
loadings, 416; sex differences, 391 

Judgment of Ability to Work with 
Others [FACToR], 232 f. 

Judgment of General Professional Skill 
[FACTOR], 233 

Judgment of Motivation for Adminis- 
trative Work [FACTOR], 232 

Judgment of Skill with Children [FAc- 
TOR [a2 21. 

Judgment of Speaking Ability [FACTOR], 
232 


Katz, Robert L., 47 

Kellogg Foundation, viii 

Kinescopes, content of, 164 ff.; prepara- 
tion of, 60; presentation of educa- 
tional problems, 24 

King, Ann, ix 

Knowledge of Administrative Practices 
and Procedures [CATEGORY], 161, 217, 
ZL0 M22 8sl gue oll ec oO One OOF 
ZIM ee Lat Ole elo oO: 
392, 397, 416 

Knowledge of Teaching Methods and 
Techniques [CATEGORY], 161, 217, 
220g) 2 Sa SL Leees SOs Oem 20S: 
2ILM 2771298, 323515925 S91 LO 

Kratz, C. Eugene, v, ix 

Kuder-Richardson formula #21, 149 f. 


Law Digest, 44 

Leader Behavior Description Question- 
naire, 225 

Leadership, 345 

Leading Action (see Takes Leading Ac- 
tion) 

Length of Speech [CATEGORY], 203 f., 
206: Thee 6 P27 35538 93 

Letter Grouping Test, 74, 79 

Literature test (see Social Studies, Lit- 
erature, and Fine Arts test) 

Livingston, 47 

Loadings (see Factor analysis) 

Logical—Intuitive [CATEGORY], 161, 221 
£3 0..2034 i iAG hy Ome 8 
283 

Lonsdale, Richard, v 


Maintaining Organizational Relation- 
ships. [COMPOSITE], 257 ff., 268, 278 
fw 280071 350,0542 8 45 Oo 7. 
392, 398 f. 


Maintaining Organizational Relation- 
ships [FACToR], 142, 310, 314, 318, 
321; 32491328 

Maintaining Relationships [CATEGORY], 
160 

Makes Decisions Effectively [CATEGORY], 
156, 187, 198): 215;)250%26 ae 
284, 297, 320, 391, 399, 416 

Makes Negative Personal Remarks [CAT- 
EGORY], 193, 197 

Makes Positive Personal Remarks [CAT- 
EGORY], 193, 197 

Makes Tentative or Definite Plans Only 
[CATEGORY], 97, 101, 109, 126, 132, 
136, 138, 140, 143, 288, 409 

Marital status of participants, 65 f. 

Materials of Instruction [CATEGORY], 
157, 168 f.; 171 ff, e074 rSGee ies 
252,41 260, 269, 2739278) 340 ee ie 
403, 415 

Mathematics Test, Aptitude, 75, 79 

Mathematics Test (See also Science and 
Mathematics test) 

Matlack, Sally, ix 

Memory (see Associative Memory) 

Men (see Sex differences) 

Mental abilities tests, 72 ff.; correla- 
tions, 151 f.,+184;.212 247 G ieee 
295; estimated factors and, 308 ff., 
326, 328; implications of study, 338; 
loadings, 414; sex differences, 389 

Methods of Instruction [CATEGORY], 157, 
167, 169, 171 f., 174, 186, 214, 252, 
260, 269, 272, 2783e280j 297 aoe ce 
326, 391, 403, 415 

Meyer, 336 

Money and Material factor, 181 

Moore, Hollis, 341 f. 

Motion pictures, 20; as background ma- 
terial for simulated school, 42 f. 

Motivation—Pupil Interest [CATEGORY], 
157, 167, 169, 171 fy 7a Green ae 
252, 260;°272, 280,92972ig eee oe 
391, 403, 415 


National Teacher Examinations (see 
Education in the Elementary School; 
Science and Mathematics; Social 
Studies, Literature, and Fine Arts) 

Nationality factors in simulated com- 
munity, 28 

Nervous Tension [FAcToR], 83 f., 154, 
185, 213, 245, 263) 296553 b2esarGe 
390, 400, 415 


NTE (see Education in the Elementary 
School; Science and Mathematics; 
Social Studies, Literature, and Fine 
Arts) 

Number Facility [FACTor], 78 f., 151, 
foams ba. 6242..261;. 270, 273; 279, 
281 f., 284, 295, 309, 326, 389, 396, 
400, 414 

Number of Items Not Attempted [cat- 
Eoory|,599 f.,.. 126,132, 136, 138 f., 
140, 259, 409 f. 

Number of Outside Groups Involved 
[CATEGORY], 100, 104, 126, 259 

Number of Outsiders Involved Individ- 
ually [CATEGORY], 100, 103f., 126, 
ioe e30., 140, 142 f., 145, 155, 182, 
210, 246, 257, 294, 301, 306, 388, 
398, 403, 408 ff., 414 

Number of Subordinate Groups In- 
volved [CATEGORY], 100, 103, 126, 
Paes 1281.38.11... 408 f. 

Number of Subordinates Involved Indi- 
vidually [CATEGORY], 100, 103, 126, 
137991003/139.1., 143, 145,-408 f. 

Number of Superiors Involved [CATE- 
GorY], 100, 103, 126, 132, 136, 140, 
ieee S22 10, 246, 257, «294, 
301, 306, 388, 399, 409 f., 414 

Number of Words (see Estimated Num- 
ber of Words) 


Objectives [CATEGORY], 157, 167, 169, 
Natt 4o91 80,214,252, 260,269, 
229027 121280; 284, 296, 317, 326; 
391, 403, 415 

Objectives, in selection of participants, 
63; of study, 7 ff., 330 

Oblimin criterion, 394 

Observed Participation by Developing 
Facts [FACTOR], 200 

Observed Participation by Raising New 
Issues [FACTOR], 201 

Occupational level of participants’ fa- 
thers, 66 

Office of Naval Research, vili 

Operationism, 8 

Oral Communication Skill (Formal), 
bole 0ne 226; 228 f:; 231f., 236, 
Poee205, 271,274, 279, 281 

Oral Communication Skill (Informal), 
Pole ton 226,228 f:, 231-1), 236, 
2ome20s 219; 281, 298, 323, 326, 
392, 397, 416 

Organization [CATEGORY], 262, 273, 277, 
279,- 287. 
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Organization of Body [CATEGORY], 203 
MeO elt U2 Se te oe} 
Organizational change, 10, 91; score, 

148 ff. 

Organizing Preparatory Work vs. Treat- 
ing Problems Summarily [FACTOR], 
410, 413 

Organizing Work [coMPosITE], 257 ff., 
2.687280 £.,°286)13.42 £7:13579392 

Organizing Work [FAcTor], 143, 314, 
3215132433258 

Out of Field [CATEGORY], 194, 197 

Outsiders Involved (see Number of Out- 
siders Involved Individually) 

Over-all Impression [CATEGORY], 217, 
DPE eS EM | 1b ce DARL CR PARTE ITC eh PAI Id! Fe 
B25 92 O91 AalG 

Over-all Rating Form, 92 

Over-all relationships of study’s) major 
areas, 394 ff. 


Paper Form Board Test, 78 f. 

Paradigm of development of in-basket 
items, 50 

Parent Teacher Associations in simu- 
lated community, 29; role in educa- 
tional planning, 32 

Parental Influence [CATEGORY], 263 

Participants, 9, 63 ff.; age of, 65; anx- 
iety of, 18; as volunteers, 64; back- 
ground, 64 ff.; characteristics, 64; ed- 
ucational level of, 67 f.; educational 
level of fathers, 66; experience of, 
67f.; father’s occupation, 66; geo- 
graphic location of, 13, 64, 380 ff.; 
listing of, 380 ff.; marital status of, 
65f.; personal characteristics of, 
69 ff.; racial factors, 64; reactions 
to Whitman School, 61 f.; representa- 
tiveness as sample, 69; social origins 
of, 66 

Participants, mental abilities (see Mental 
abilities ) 

Participants, performance (see Perform- 
ance ) 

Participants, personality factors 
Personality factors) 

Participants, professional and general 
knowledge (see Professional and gen- 
eral knowledge) 

Participants, selection of, methods of 
choosing, 14; objectives in, 63 

Participants, sex differences (see Sex 
differences) 

Participants, values of (see Values) 


(see 
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Participants, vocational interests (see 
Vocational interests) 

See also Principals, elementary 
Participation (see Pupil Participation) 
Perceived Effectiveness [FACTOR], 200 
Performance, components of, 10; con- 

sistency of, 124 ff.; correlations with, 
188, 217; criteria, lack of, 4; dimen- 
sions, as study objective, 7 f.; dimen- 
sions of in-basket tests, 10, 120 ff.; 
Ratings for School Principals, 226; 
relationships among measures of, 10 

Performance, subjective evaluation, 10, 
219 ff.; by in-basket scorers, 220 f.; 
by research staff members, 221 ff.; by 
superiors, 226 ff.; by teachers, 224 ff.; 
correlations, 158 ff., 239 ff.; descrip- 
tion of measures, 220 ff.; estimated 
factors and, 322 ff.;  interrelation- 
ships, 233 ff. 

Personal characteristics of participants, 
69 ff. 

Personality factors, 80 ff.; correlations, 
153 Peels ral 2 4 ae eee 
295 f.; estimated factors and, 311 ff., 
326, 328; implications of study, 336, 
356 ff.; loadings, 415; sex differences, 
390 

Personality of Teachers [CATEGORY], 157, 
LOS fl ete 4 8602 14252? 
2609269027278 27880280 6282297, 
317, 326, 391, 403, 415 

Personnel development, conceptual 
problems, 53; human problems, 52; 
technical problems, S51 f. 

Physical and Fiscal Organization [CAT- 
EGORY], 157, 178 ff., 186, 214, 252, 
260, 297, 317, 326, 391, 401, 416 

Physical Aspects of Instruction (see 
Concern for Physical Aspects of In- 


struction ) 
Physical Setting—Classroom [CATEGORY], 
TS7eR LOS Testy 1 tel 4 ee S62 14° 


252, 260, 296, 317, 391, 403, 416 

Picture Numbers Test, 78 f. 

Planning and Continuity [CATEGORY], 
1579167 169) 17 lito ee TS GND 14, 
25259260, 26975 272271280 90; 
31759391 403 415 

Planning and Structure [CATEGORY], 157, 
178 fb4186592:1 425226059 2697027 3% 
279 £.,.282;.297; 317) 326, 391» 401, 
416 

Plans Only (see Makes Tentative or 
Definite Plans Only) 


Political affiliation in simulated com- 


munity, 28 

Precision, Clarity, and Organization 
[FACTOR], 205 

Prejudges, Makes Unwarranted As- 


sumptions, or Largely Inappropriate 
Perception [CATEGORY], 100, 106, 122, 
126, 155, 182, 218247 ao eee 
307, 389, 399 

Preparation for Decision vs. Taking 
Final Action [FACToR], 145, 272, 
285 ff, 291; 305) "310 fas ioeeee 
325, 327:£., 338 £, 402 11,4077 are 

Presents Facts Effectively [CATEGORY], 
156,187, 198) 200)9 2153 2505e one 
270, .284, 297, 320) 9°326,8391 eo: 
416. 

Principal Behavior Description Ques- 
tionnaire, 17; 224,°233 12 aes 
348; content, 225 f. 

Principals, elementary, characteristics, 
for initiating structure, 254; charac- 
teristics, of consideration, 253 f.; 
classroom teaching of, 64; monthly 
meeting in simulated community, 31; 
reasons for study of, 1; selection of, 
8; viewed by in-basket scorers, 251; 
viewed by research staff members, 
253; viewed by superiors, 251; viewed 
by teachers, 253 

Principals, elementary, values of (see 
Values) 

See also Participants 

Problem solving, theory of, 6 

Problems developed for in-basket tests, 
48 

Profession, role of, 349 ff. 

Professional and general knowledge, 
implications of study for, 338; re- 
sponsibilities of profession, 350 f. 

Professional and general knowledge 
tests, 70 ff.; correlations, 151 f., 184, 
212, 242, 262, 298; estimated factors 
and, 308 ff., 326, 328; loadings, 415; 
sex differences, 389 

Professional Experience Record, 17 

Program for test week, 17 ff. 

Program Values (see Uses Program 
Values in Analysis) 

Pronunciation [CATEGORY], 203 ff., 261, 
210,273, 277,279; 282 see 

Proper Word Usage [CATEGORY], 203 ff., 
261, 270; 273, 279, 28252845393 

Public Relations [CATEGORY], 157, 178 


ieaatson214, 252, 260,269,278, 297, 
317, 391, 401, 416 

Pupil Characteristics [CATEGORY], 263 

Pupil Discipline [CATEGORY], 263 

Pupil Education [CATEGoRY], 263, 281, 
296, 312, 390, 415 

Pupil Participation [CATEGORY], 157, 
1672169" 171 ff:;'186, 214, 252,260, 
20908212280; 297;> 317; 2391, 403, 
415 

Pupil Personnel [CATEGORY], 157, 178 
feeipon 14, 252;:260, 273, 277,279, 
282297, 317, 391, 401, 416 

Pupil Reaction (see Concern for Pupil 
Reactions) 


Quantification, problems in, 5 
Questions or Opposes Arguments of 
Others [CATEGORY], 192, 197 


Racial factors, in simulated community, 
28; of participants, 64 

Radicalism vs. Conservatism [FACTOR], 
82, 84, 154, 213, 245, 263, 296, 312, 
390, 415 

Raises New Issues [CATEGORY], 156, 193, 
197.4.,2200, 250, 261 

Ramey, James, v, ix 

Rapport with School Children [CATE- 
GORY|fo16),) 217, 226, 228 f:, 231 f., 
Deon 55120), 298, 323, 392, 397, 
416 

Ratoosh, Philburn, 95 

Reasoning Test, 74, 79 

Reasons-for-Action Form, 23 f., 25, 59, 
99, 106 

Recognition for Good Work (see Gives 
Recognition for Ability or Good 
Work) 

Recordings, tape, 21; as background 
material for simulated community, 41, 
45 f.; content of, 175 ff.; interaction of 
teachers, 26f.; preparation of, 60f.; 
presentation of educational problems, 
24; presentation of in-basket prob- 
lems, 23 f. 

Refers to Superiors [CATEGORY], 102, 
1159121795259; 278 

Rejection of Test Conditions [CATE- 
GoRY], 99 f., 126 

Relates to Background Material or to 
Other Items [CATEGORY], 100, 105 f., 
12698132, 136.5140, 14255155, 9182, 
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210, 246, 257, 294, 301, 306, 388, 
396, 408 f., 414 

Relationship with Others [FACToR], 181 

Reliability in scoring, 124, 149 f.; in- 
structional awareness, 169 f. 

Religious affiliation in simulated com- 
munity, 28 

Reminds about Time [CATEGORY], 192, 
197 

Replications of study, 353 

Representativeness of sample, 69 

Requires Further Information [CATE- 
GoRY], 97, 101, 108, 126, 132, 135f., 
138, 140, 145, 288, 408 f. 

Research, future, implications of study, 
Bo 2st 

Research staff (see Staff) 

Resourceful—Notionless [CATEGORY], 161, 
DLN 23 Om LOS 24 eden 29 OL 
Salts 

Responding to Outsiders [CATEGORY], 
160 

Responding to Outsiders [COMPOSITE], 
PPM Sits ASS, PRINS PAR BBE SOE 
342, 350, 392, 398 

Responding to Outsiders [FACTOR], 143, 
31 if 18932.198324.5328 

Responding with Prompt Decisions [FAc- 
ToR], 410, 413 

Reutter, E. Edmund, Jr., ix 
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Sample (see Participants) 

Saunders, David R., 85 

School Administration and Supervision 
Lest tale U Leola O2.al 83.1: 
DA Dee) 4 latte 6298 2.0, eee eli ds 
279, 280, 282, 284, 298, 309 f., 326, 
338, 341, 389, 396, 415 

School community survey for simulated 
situation, 41 ff. 

School districts participating in study, 
12: 

School districts, simulated township, 30 


School, methods for choosing partici- 
pating, 12 f. 

Schools, simulated, 9, 26 ff.; background 
information on, 19 

See also Whitman School 

Staff [CATEGORY], 262, 273, 276, 279, 
281 

Science and Mathematics test, 22, 70 f., 
151 f., 160, 184, 212, 242, 262, 270, 
273, 298, 309, 326, 389, 396, 415 
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Score Sheet, 92 f., 148; development of, 
88 

Scorers, In-basket, Check List of, 236 f., 
25655263 

Scorers, In-basket, selection and train- 
ing of, 94; subjective evaluations 
made by, 220; views of principal, 251 

Scorers’ In-basket Rating [CATEGORY], 
ESS) LOLS Si 2 eT 2 3 ee 8 
240, 242, 244 ff., 250, 252, 265, 274, 
D7 OT 27 O28 Peel So elo oP LoL, 
393, 399, 401, 416 

Scores, composite, 256 ff., 269 ff.; sex 
differences, 393; unique components 
distinguished from, 290, 325 ff. 

Scoring in-basket tests, 9 f.; consistency 
of performance, 124 ff.; content, defi- 
nition, 86; control of quality in, 
94 ff.; correlations, 150; 154 ff.) 182, 
210 1:0243,9246 fh 2597-294 0areval- 
uation vs. description, 92; imagina- 
tive score, 148 ff.; meaning of a total 
score for a category, 121 ff.; organi- 
zational change score, 148 ff.; proce- 
dures for, 97f.; ratings, 91 f.; relia- 
bility, 125, 149f.; style, definition, 
86; system used, 92 ff. 

Scoring in-basket tests, categories used 
in, 98 ff.; content, 88 ff., 148 ff.; sty- 
listic, 87 f. 

Scoring in-basket tests, factor analysis 
(see Factor analysis) 

Scoring Manual, 93 

Selection, of administrators, implica- 
tions of study, 332 ff.; of elementary 
principals, 8 

Self-contained classroom in simulated 
school, 33 

Sets Deadline (see Imposes Controls: 
Sets a Deadline) 

Sex [CATEGORY], 187, 215, 240, 299, 
320, 402, 416 

Sex differences, 64; implications of 
study and, 332 ff.; in administrative 
experience, 67; in age, 65; in educa- 
tional level, 67; in marital status, 
65 f.; in social origins, 66; in teaching 
experience, 67; variables of study 
analyzed, 388 ff. 

Sheehan, Patricia, v 

Shows Awareness of Poor Work [CAT- 
EGORY], 100, 105, 126, 132, 136, 140, 
142 f., 409 f. 

Simon, Herbert, 6 

Simulated community (see Jefferson) 


Simulated school, 9, 26 ff.; background 

information on, 19 
See also Whitman School 

Simulation, as training device, 344 f.; 
limitations, 345; strengths, 344 

Sixteen Personality Factor Question- 
naire, 17, 70, 80 ff., 243, 311 

Skill, approach in job analysis, 47; pro- 
fessional, 351 

Slipshod—Painstaking [CATEGORY], 161, 
221 f., 236, 263,271) 2748279 eee te 
28ait: 

Social classes and educational goals, 67 

Social origins of participants, 66 

Social Studies, Literature, and Fine 
Arts test, 22, 70 f.; ISH f- e160 mise: 
212; 242, 262, 270) 2735e2aeee ous 
282, 284, 298, 309, 338, 389, 396, 
398, 415 

Socially Insensitive [CATEGORY], 
10534126,72597272 

Socio-economic status of 
community, 28 

Sociometric tests, 25 

Sophistication vs. Rough Simplicity 
[FACTOR], 82, 84, 154, 185, 213, 245, 
263, 296, 312, 3908455 

Spearman-Brown formula, 125, 220f., 
22754) 

Speech, 10; categories, 203; collection 
of data, 202; correlations, 261; factor 
analysis, 205 ff.; relationships with 
other variables, 208 f.; sex differences, 
393 

Speech performance, 201 f.; consistency 
of, 202 ff. 

Speed of Closure [FAcTor], 75 f., 79, 
151, 184, 212,- 2423626 e270 ae 
279, 281, 284, 295, 309, 326,°389, 
396 f., 402, 414 

Spontaneity in behavior, 56 

Staff as Educators [CATEGORY], 264 

Staff as People [CATEGORY], 263, 273 

Staff Handbook (Jefferson Faculty), 21, 
33, 44 f. 

Staff (research) Evaluation Form, 223; 
theories of, 5 f.; views of principal, 
253 

See also Faculty; Teachers 

Staff Members’ Rating [CATEGORY], 158, 
188, 217, 234, 238, 240, 242, 244 ff., 
250, 252; 265, 2747 279s 208eeas 
329, 392, 399, 416 

Stanford Grade Placement Achievement 
Tests, 35 


100, 


simulated 


Stice, Glen F., v, 85 

Sticking to a Job (see Capacity to Stick 
to a Job in Spite of Difficulty) 

Strong Vocational Interest Blank for 
Mienmty i), /21.,1524., 185, 209, 
meee es 11.4250, 264572715'275, 277, 
2799251, 284, 292; 296, 311 ff: 315; 
328, 339, 390, 415 

Structure (see Planning and Structure) 

Structuring of Whitman School, 39 f. 

Students per classroom in simulated 
school, 35 

Study Guides, 20 f. 

Study of the Whitman School Faculty, 
20435255 

Subjective evaluations (see Perform- 
ance, subjective evaluation) 

Subjects (see Participants) 

Subordinate Groups Involved (see Num- 
ber of Subordinate Groups Involved) 

Subordinates Involved (see Number of 
Subordinates Involved Individually) 

Subtraction and Multiplication Test, 78 f. 

Suggests a Role [CATEGORY], 192, 197 

Suggests Criteria [CATEGORY], 193, 197 

Suggests New Procedures [CATEGORY], 
oom ts 7.8192.0197 £.,°200, 215, 250, 
Ole 3200591; 399,416 

Summarizes [CATEGORY], 193, 197 

Superintendents in simulated township, 
30 

Superiors Involved (see Number of 
Superiors Involved) 

Superiors Over-all Impression [FACTOR], 
397, 404 f. 

Superiors’ Rating [CATEGORY], 158, 161, 
188, 217, 234, 238, 240, 242, 244 ff., 
pou 2 8 os.) 274; 276T,, 297 f., 
32359326, 329, 393, 416 

Superiors Rating Form, 17, 237 

Superiors, subjective evaluations of, 
226 ff. 

Superiors’ views of principal, 251 

Supervisor's Manual, 18 

Supports Others’ Arguments [CATEGORY], 
192, 197 

Suspicious vs. Trusting [FACTOR], 82, 
Sami SS, )213,° 245,'°263; 296, 
312, 390, 400, 415 

Swartout, Sherwin, ix 


Table titles, listing of, xiii 
Tactful—Tactless [CATEGORY], 161, 221 f., 
230.4205, 2/71, 274,279, 281, 283 f. 
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Takes Leading Action [CATEGORY], 97, 
LOT GLa 26; Pi Soe el OOm 1 41cm 3, 
AD al) elo 2.6210. 2469257 88; 
294, 301, 306, 388, 400, 408 ff., 414 

Takes Terminal Action [CATEGORY], 97, 
LODOE 1 OMI26 2 3201869138 tral4 15 
E45 At 5518255. 2105 24600257 2088) 
294, 301, 306, 388, 401, 403, 409 f., 
414 

Tape recordings (see Recordings) 

Teacher Behavior (see Concerns with 
Teacher Behavior) 

Teachers’ Impressions [FACTOR], 402, 
404 f. 

Teachers’ Qualifications [CATEGORY], 263 

Teachers’ Questionnaire Scores, 158, 
188, 217, 234, 238, 240, 242, 244 ff., 
250782) 2920579298 525-5 20.6329, 
392, 402, 416 

Teachers’ Reaction Form, 17, 234, 348; 
content, 224 f. 

Teachers, subjective evaluations made 
by, 224 ff.; views of principal, 253 

See also Faculty of simulated 
school 

Teachingexperience of participants, 67 f. 

Technical problems, community rela- 
tionships, 53; educational program, 
49 f.;funds and facilities maintenance, 
54; personnel development, 51 f. 

Technical skill, 47 

Terminal Action (see Takes Terminal 
Action) 

Test (see specific tests) 

Test centers, 15; criteria for choosing, 
15; geographic location, 13, 16 

Test materials for simulated school, 41 
ff. 

Test week, arrangements for, 12 ff.; 
program for, 17 ff. 

Theisen, W. W., 2 

Theories, administration, decision mak- 
ing, 6; problem solving, 6 

Theories, held by research staff, 5 f.; 
implications of study for, 352; in- 
adequacy of, 7 

Thurstone, L.L., 128 

Total Experience [CATEGORY], 187, 215, 
240,265) 216702993 205503260392, 
402, 416 

Tucker, Ledyard, ix, 300 


Uncontrolled Delegation (see Delegates 
Partially but without Control) 
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Understanding Written Communication 
IGATEGORY [LO let 205228 ee Ota, 
236912387820) eo Lee OO, 
392, 397, 416 

United States House of Representatives, 
Appropriations Committee, viii 

United States Office of Education, Co- 
operative Research Branch, iv, Vii, viii 

University Council for Educational Ad- 
ministration, Vii, Vill 

Unusual Courses of Action [CATEGORY], 
O71 00. 104.01 229620. alo eee 0: 
140, 408 f. 

Urbane—Rough [CATEGORY], 161, 221 f., 
D3 681263 42112142 eee Lee Oe, 
283314 

Uses Human or Personal Values in 
Analysis [CATEGORY], 100, 106 f., 126, 
ESSVELS 2502 1247 Oe OD en 2 
276, 278, 295, 307, 347, 389, 400 

Uses Physical Values in Analysis [CAT- 
EGORY], 100, 107, 126, 347 

Uses Program Values in Analysis [CAT- 
EGORY], 100, 107, 126, 132, 136, 140, 
L421 SS. LS2se2 LO 24 Oy 254, 
301, 306, 347, 388, 400, 409, 414 

Usual Courses of Action [CATEGORY], 
09 fol 26591325135 fe 138 eae 4 5: 
408 ff. 


Values, job performance (see Job per- 
formance values) 

Values, principals, elementary, 10; par- 
ticipants, 163 ff. 

Values, professional, 349 f. 

Verbal Knowledge [FAcTor], 75, 79, 
TL 84 02 1? 40 6 lee Onno 3 
QT ie 219 28 V 18295713 093265359, 
396, 398, 414 

Visualization [FACToR], 78 f., 151, 184, 
D226 2) Oe el 
295, 309, 326, 389, 396, 414 

Vocational interests, 17, 70, 72 f., 152 f., 
18590209062 13224312 Ose 64 ey 
D1DSe21 154219, 828 L842 9 OF 
SUN Ry RW lse SA.) SER CETOe Cate Tie 
plications of study, 339 

Voice Control [CATEGORY], 203 f., 206 f., 
261552705 27332775 281-393 


Voice Control and Delivery [FACTorR], 
207 

Voice Interest [CATEGORY], 203 f., 206 f., 
261,°270, 27355393 


Wald, Abraham, 95 

Watson, Betty, ix 

Weights in scoring system, 230 

Whitman School, 35 f.; background ma- 
terials for, 41 ff.; criteria used in se- 
lection of background for, 39 f.; 
structuring of, 9, 39 ff. 

Whitman School faculty (see Faculty 
of simulated school) 

Whitman School Magazine, 21 

Will Control and Character Stability 
[FACTOR], 83 £.,. 15451 Sseec oes, 
263, 296, 312, 390, 400, 415 

Witkin, H. A., 357 

Witt, Eleanore, ix 

Witty—Humorless [CATEGORY], 161, 221 
f., 236, 263, 271,274,502 ee eos 

Women (see Sex differences) 

Word Fluency [FAcTor], 77, 79, 151, 
184, 212, 242;-2625027 0 eo 
281, 284, 295, 309, 389, 396, 414 

Word Usage (see Proper Word Usage) 

Wordy-Terse [CATEGORY], 161, 221 f., 
236, 263, 271, 27427 Gaz eee es. 
PRES E 

Work Scheduled for Same or Following 
Day [cATEGory], 101, 109f., 126, 
132,-.136, 140; 14258 Tasso cele. 
210, 246, 257, 288, 294, 301, 306, 
388, 403, 408 f., 414 

Work Scheduled for Same or Follow- 
ing Week [CATEGORY], 101, 110, 126, 
132, 136, 140). 142 aS soa 
210, 246, 257, 294, 301, 306, 388, 
403, 408 f., 414 

Work Scheduled: Indefinite Time or 


No Time Specified [CATEGORY], 97, | 


101, 110, 126, 99320513 Geiecemrao: 
142, 409 
Wrigley, Charles, 7 


Written Communication Skill [CATE- | 
GORY], 161, 21759226;92 28a, | 


236, 238, 265, 275,92 /4eee ees: 
392, 397, 416 
Wynn, D. Richard, v 
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